-- Logs begin at Thu 2022-07-14 14:57:42 UTC, end at Thu 2022-07-14 16:15:59 UTC. -- Jul 14 15:45:55.437081 dv-cinder-837164-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:45:55.445075 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:45:55 2022] *** Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: nodename: dv-cinder-837164-3-iscsi Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: machine: x86_64 Jul 14 15:45:55.447684 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: clock source: unix Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: pcre jit disabled Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: detected number of CPU cores: 4 Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: current working directory: / Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: your processes number limit is 47680 Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: your memory page size is 4096 bytes Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: detected max file descriptor number: 2048 Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: lock engine: pthread robust mutexes Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: thunder lock: enabled Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:45:55.448114 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:45:55.491084 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: Python main interpreter initialized at 0x555976c979c0 Jul 14 15:45:55.491084 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: python threads support enabled Jul 14 15:45:55.491084 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: your server socket listen backlog is limited to 100 connections Jul 14 15:45:55.491084 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:45:55.491399 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:45:55.491490 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: *** Operational MODE: preforking *** Jul 14 15:45:55.491725 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:45:55.491725 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: spawned uWSGI master process (pid: 115466) Jul 14 15:45:55.491923 dv-cinder-837164-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:45:55.494317 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: spawned uWSGI worker 1 (pid: 115467, cores: 1) Jul 14 15:45:55.494317 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: spawned uWSGI worker 2 (pid: 115468, cores: 1) Jul 14 15:45:55.494317 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:45:56.154476 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:45:56.155082 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:45:57.272985 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:45:57.272985 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: from cryptography.utils import int_from_bytes Jul 14 15:45:57.274223 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:45:57.274223 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: from cryptography.utils import int_from_bytes Jul 14 15:45:57.277089 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:45:57.277089 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: from cryptography.utils import int_from_bytes Jul 14 15:45:57.277518 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:45:57.277518 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: from cryptography.utils import int_from_bytes Jul 14 15:45:59.756248 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:45:59.756815 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:45:59.757022 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:45:59.757124 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:45:59.757479 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:45:59.757570 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:45:59.757663 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:45:59.758430 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:45:59.758573 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.758797 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:45:59.758894 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.759054 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:45:59.759216 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.759441 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.759527 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.759770 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.759857 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760093 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760178 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760418 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760532 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760748 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.760834 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761059 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761146 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761336 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761429 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761654 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.761741 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762008 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837164-3-iscsi {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762099 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762275 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762372 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762591 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762676 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.762917 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837164-3-iscsi {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763003 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763234 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763319 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763542 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763634 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763851 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.763935 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.764160 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.764247 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.764465 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.764652 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.764809 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.765775 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.765931 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.765931 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766128 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766225 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766317 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766407 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766495 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766621 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766742 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766836 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.766931 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767011 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767117 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767211 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767424 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767536 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767742 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.767831 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768050 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768232 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837164-3-iscsi {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768375 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768551 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768685 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.768868 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769079 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837164-3-iscsi {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769187 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769394 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769599 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769752 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.769941 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770045 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770255 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770444 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770582 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770755 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.770981 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771068 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771296 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771382 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771628 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771721 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.771952 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772049 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772273 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772361 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772598 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772684 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772903 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.772987 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773214 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773328 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773543 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773629 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773871 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.773960 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774283 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774493 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774577 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774748 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.774832 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775060 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775161 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775325 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775411 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775640 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775725 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.775962 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776060 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776245 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776330 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776498 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776585 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776818 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.776912 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777065 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777160 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777383 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777478 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777702 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.777789 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778035 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778122 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778341 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778447 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778648 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778733 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.778952 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779037 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779257 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779353 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779558 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779642 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779865 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.779956 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780169 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780274 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780503 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780650 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780796 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.780891 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781114 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781200 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781422 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781514 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781742 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.781921 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782077 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782172 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782402 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782493 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782708 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.782795 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783021 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783108 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783344 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783436 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783650 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783734 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.783964 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784049 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784273 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784359 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784579 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784673 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784885 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.784979 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785191 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785287 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785507 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785601 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785761 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.785875 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786105 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786192 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786388 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786486 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786690 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786789 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.786995 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787083 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787311 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787405 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787617 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787703 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.787923 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788014 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788229 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788323 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788529 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788835 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.788950 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789167 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789264 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789471 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789565 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789776 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.789915 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790105 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790410 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790496 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790717 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.790809 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791020 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791112 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791324 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791410 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791642 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791727 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.791949 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792036 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792256 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792342 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792563 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792659 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792869 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.792963 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793173 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793271 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793481 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793572 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793786 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.793885 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794115 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794199 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794422 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794506 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794729 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.794815 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795034 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795120 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795340 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795431 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795651 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795737 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.795952 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796046 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796261 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796355 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796561 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796647 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796868 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.796997 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797173 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797266 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797477 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797563 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797779 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.797882 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798109 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798206 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798409 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798493 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798712 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.798796 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799014 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799108 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799315 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799399 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799615 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799700 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.799915 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800002 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800233 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800538 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800622 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800846 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.800939 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.801151 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.801238 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.801454 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.801552 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.801773 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:45:59.801913 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802132 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802262 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802462 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802555 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802807 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.802894 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803126 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803213 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803460 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803555 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803794 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.803879 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.804110 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.804201 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.804424 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.804515 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.805260 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.805347 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.805573 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.805657 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.805914 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806016 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806228 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806313 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806540 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806633 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806860 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.806967 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.807177 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.807264 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.807744 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.807848 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808065 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808158 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808375 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808460 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808692 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.808788 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809006 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809101 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809323 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809410 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809633 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809717 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.809991 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810080 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810309 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810395 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810642 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810726 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.810972 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811066 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811381 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811597 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811681 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.811910 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812005 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812223 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812310 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812533 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812620 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812845 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.812933 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813164 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813248 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813489 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813584 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813800 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.813943 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814138 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814223 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814452 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814550 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814764 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.814849 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815073 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815158 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815386 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815480 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815698 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.815786 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816014 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816106 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816328 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816422 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816646 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816731 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.816958 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817042 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817273 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817360 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817583 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817669 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.817986 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818094 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818295 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818381 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818602 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818701 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818910 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.818996 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819214 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819299 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819524 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819611 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819832 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.819926 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.820144 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.820852 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821081 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821183 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821395 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821491 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821706 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.821792 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822046 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822150 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822359 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822459 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822664 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822755 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.822974 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823059 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823282 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823591 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823683 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823902 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.823994 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824210 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824309 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824512 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824597 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824836 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.824922 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825141 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825234 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825448 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825533 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825756 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.825891 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826093 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826182 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826404 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826490 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826713 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.826799 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827022 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827108 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827334 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827424 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827646 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827740 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.827957 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828274 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828359 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828587 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828682 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828900 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.828984 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829225 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829312 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829531 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829624 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829876 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.829966 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830186 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830282 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830497 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830599 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830803 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.830896 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831111 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831195 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831414 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831508 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831719 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.831858 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832020 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832104 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832325 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832426 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832628 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832720 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.832929 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833013 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833234 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833322 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833541 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833635 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833866 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.833953 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834173 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834261 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834480 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834566 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834783 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.834867 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.835090 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.835185 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.835397 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.835484 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.835739 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.836351 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.836587 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.836686 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.836930 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837020 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837293 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837388 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837614 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837701 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.837960 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838049 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838274 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838372 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838588 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838681 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838897 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.838982 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839211 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839303 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839526 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839836 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.839926 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840156 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840253 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840474 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840566 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840778 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.840863 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841091 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841179 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841408 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841492 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841716 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.841804 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842057 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842146 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842366 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842498 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842682 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.842771 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843018 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843111 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843340 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843426 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843722 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843818 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.843971 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844115 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844281 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844398 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844590 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844707 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844899 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.844998 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845207 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845303 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845522 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845652 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845841 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.845976 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846164 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846261 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846470 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846564 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846787 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.846873 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847092 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847177 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847409 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847503 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847714 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.847807 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848028 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848115 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848329 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848423 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848643 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848730 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.848967 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849051 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849280 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849368 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849591 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849677 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.849922 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850061 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850236 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850325 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850544 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850630 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850850 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.850934 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.851156 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.851244 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.851504 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852086 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852317 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852404 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852711 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.852936 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853022 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853244 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853339 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853552 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853638 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853880 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.853969 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854186 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854282 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854492 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854580 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854795 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.854887 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855100 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855195 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855412 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855498 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855735 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.855826 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856143 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856352 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856437 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856659 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.856744 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857020 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857115 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857284 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857371 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857587 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857672 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.857918 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858018 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858224 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858309 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858531 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858837 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.858925 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859149 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859241 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859467 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859553 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859771 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.859865 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860084 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860169 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860401 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860496 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860707 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.860799 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861020 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861111 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861328 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861426 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861640 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861726 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.861971 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862059 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862286 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862385 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862593 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862716 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862901 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.862986 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863211 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863313 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863525 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863612 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863829 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.863923 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864229 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864446 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864532 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864759 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.864846 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.865070 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.865158 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.865380 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.865468 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.865692 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866014 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866120 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866355 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866582 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866668 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.866918 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867004 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867261 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867354 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867583 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867677 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.867909 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868006 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868230 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868319 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868564 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868650 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868872 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.868970 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869185 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869348 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869494 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869589 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869800 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.869909 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870133 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870219 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870440 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870528 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870743 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.870828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871142 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871354 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871446 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871657 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871749 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.871957 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872055 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872260 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872389 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872561 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872648 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872864 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.872961 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873165 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873258 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873476 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873569 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873777 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.873924 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874112 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874205 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874419 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874506 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874721 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.874818 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875025 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875111 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875328 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875421 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875632 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875727 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.875936 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876023 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876280 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876367 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876588 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876676 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.876927 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877021 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877232 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877318 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877538 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877633 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877884 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.877974 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878192 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878290 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878498 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878585 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878803 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.878899 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879104 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879197 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879408 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879495 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879711 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.879797 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880015 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880108 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880320 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880418 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880634 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880765 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.880945 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881060 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881254 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881355 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881563 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881676 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881888 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.881991 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.882200 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.882299 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.882504 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.882599 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.883324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.883412 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.883632 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.883720 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.883936 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884023 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884243 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884329 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884548 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884636 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884853 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.884947 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885153 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885239 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885466 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885551 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885769 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.885888 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886099 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886191 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886402 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886493 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886706 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.886802 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887010 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887095 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887313 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887399 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887619 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887713 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.887926 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888013 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888227 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888312 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888532 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888626 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888840 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.888927 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889142 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889234 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889441 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889528 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889745 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.889848 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890077 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890175 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890388 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890476 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890690 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.890775 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891001 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891086 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891307 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891394 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891613 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891698 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.891915 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892002 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892221 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892308 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892522 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892606 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892824 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.892918 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893125 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893220 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893426 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893519 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893727 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.893901 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894074 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894161 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894384 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894481 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894689 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894785 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.894996 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895083 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895300 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895386 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895618 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895774 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.895927 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896032 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896269 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896409 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896575 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896664 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.896934 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897020 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897242 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897336 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897554 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897639 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897889 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.897978 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.898204 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.898289 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899042 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899139 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899365 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899450 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899673 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899760 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.899983 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900069 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900289 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900594 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900679 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900897 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.900983 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901202 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901288 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901519 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901617 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901845 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.901987 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902163 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902250 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902484 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902585 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902786 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.902871 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903095 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903182 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903409 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903504 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903715 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.903801 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904019 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904105 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904325 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904423 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904633 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904726 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.904943 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905036 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905253 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905339 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905562 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905647 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905894 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.905984 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906202 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906290 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906509 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906595 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906814 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.906898 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907113 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907199 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907421 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907507 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907729 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.907816 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908032 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908118 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908340 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908425 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908642 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908736 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.908949 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909034 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909251 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909337 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909564 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909660 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909900 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.909990 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.910302 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.910387 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.910611 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.910709 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.910923 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911009 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911230 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911317 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911543 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911671 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.911858 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912018 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912174 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912329 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912487 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912749 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.912834 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913065 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913195 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913381 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913508 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913695 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.913838 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914054 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914182 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914366 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914490 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914681 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.914802 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915008 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915117 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915316 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915443 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915621 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915750 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.915924 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916056 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916246 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916363 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916552 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916685 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916875 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.916989 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.917293 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.917381 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.917604 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.917713 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.917942 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918061 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918360 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918671 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918757 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.918981 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919068 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919306 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919394 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919629 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919716 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.919954 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920259 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920345 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920571 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920667 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920881 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.920966 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921191 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921285 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921517 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921611 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921837 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.921935 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922165 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922259 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922470 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922556 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922774 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.922905 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923099 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923195 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923411 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923496 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923722 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.923807 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924046 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924144 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924447 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924532 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924761 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.924847 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925074 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925160 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925396 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925482 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925702 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.925793 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926037 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926126 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926350 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926436 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926659 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926752 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.926968 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927065 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927276 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927369 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927587 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927672 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927894 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.927981 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928202 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928293 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928510 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928603 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928815 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.928900 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929118 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929203 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929422 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929540 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929764 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.929885 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930092 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930180 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930416 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930510 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930727 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.930813 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931051 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931144 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931360 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931453 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931665 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931750 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.931986 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.932074 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.932292 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.932384 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.932853 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.932982 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933158 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933243 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933463 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933558 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933795 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.933899 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934125 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934210 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934452 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934542 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934780 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.934875 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935096 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935182 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935409 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935499 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935744 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.935831 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936058 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936190 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936378 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936462 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936696 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936832 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.936999 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937094 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937305 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937390 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937608 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937692 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.937936 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938038 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938245 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938331 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938548 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938632 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938853 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.938947 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939154 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939247 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939457 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939550 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939757 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.939843 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940058 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940149 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940371 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940456 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940679 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940765 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.940991 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941077 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941298 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941384 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941600 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941686 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.941927 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942015 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942232 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942353 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942563 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942651 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942884 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.942982 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943205 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943370 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943525 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943849 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.943942 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944180 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944274 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944499 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944587 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944829 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.944934 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.945641 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.945753 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946003 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946094 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946323 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946409 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946642 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946737 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.946958 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947052 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947274 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947366 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947584 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947671 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947896 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.947989 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.948211 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.948296 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.948527 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.948620 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.948846 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.949045 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.949368 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.949455 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.949683 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.949770 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950024 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950151 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950339 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950427 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950654 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950746 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.950967 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951052 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951278 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951434 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951587 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951674 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951902 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.951989 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952213 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952311 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952524 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952609 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952855 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.952942 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.953180 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.953277 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.953505 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.953591 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.953879 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954013 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954165 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954255 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954484 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954587 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954795 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.954887 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955114 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955209 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955440 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955526 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955749 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.955845 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956067 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956154 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956380 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956474 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956692 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.956786 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957004 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957092 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957311 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957396 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957621 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957708 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.957958 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958057 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958270 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958357 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958578 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958665 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958890 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.958977 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959204 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959298 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959521 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959608 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959845 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.959931 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960160 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960256 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960477 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960564 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960825 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.960915 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.961647 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.961742 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.961986 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.962199 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.962510 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.962597 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.962829 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.962929 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963158 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963282 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963482 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963575 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963795 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.963890 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964112 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964199 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964430 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964528 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964739 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.964825 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965049 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965137 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965354 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965447 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965663 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965749 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.965996 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966095 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966389 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966620 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966714 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.966926 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967014 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967229 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967314 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967542 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967636 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.967850 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.968075 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.968380 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.968476 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.968725 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.968810 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969041 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969126 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969365 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969460 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969686 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.969773 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970022 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970122 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970334 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970429 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970647 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970733 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.970957 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971049 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971264 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971363 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971574 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971664 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971883 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.971968 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972187 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972274 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972490 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972581 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972799 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.972884 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973107 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973200 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973410 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973495 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973712 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.973797 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974041 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974166 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974370 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974458 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974680 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974775 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.974995 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975083 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975301 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975388 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975614 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975713 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.975918 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976005 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976224 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976316 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976554 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976653 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976859 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.976952 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977163 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977249 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977467 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977561 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977773 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.977876 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978102 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978188 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978407 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978504 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978709 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.978802 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979020 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979107 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979370 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979469 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979676 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979762 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.979984 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980069 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980291 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980385 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980619 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980720 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980911 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.980997 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981221 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981309 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981536 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981624 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981866 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.981958 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.982217 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.982318 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.982533 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.982747 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983064 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983164 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983396 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983527 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983716 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.983804 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984051 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984144 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984364 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984460 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984673 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984759 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.984982 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985077 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985288 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985373 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985605 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985698 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.985941 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986041 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986255 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986349 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986564 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986649 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986872 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.986959 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987183 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987302 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987492 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987617 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987801 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.987888 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988107 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988193 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988415 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988500 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988721 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.988807 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989028 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989113 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989335 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989434 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989642 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989729 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.989989 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990092 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990333 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990430 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990656 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990752 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.990974 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991061 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991291 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991387 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991611 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991704 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.991925 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992042 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992260 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992349 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992570 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992657 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992882 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.992969 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993199 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993287 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993511 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993641 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993835 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.993924 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994155 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994265 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994574 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994663 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994896 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.994991 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995213 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995299 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995523 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995609 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995833 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.995928 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996159 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996247 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996472 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996558 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996785 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.996883 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997095 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997406 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997497 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997737 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.997850 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998101 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998189 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998430 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998516 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998743 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.998838 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999050 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999136 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999357 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999443 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999661 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999748 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:45:59.999971 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000065 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000280 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000379 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000587 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000674 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000892 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.000977 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001193 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001287 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001498 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001590 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001801 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.001939 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002128 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002227 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002433 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002519 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002735 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.002827 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003039 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003134 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003341 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003433 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003645 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003730 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.003947 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004034 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004251 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004339 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004555 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004647 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004863 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.004949 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005170 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005257 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005475 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005564 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005783 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.005889 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006110 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006208 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006459 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006554 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006717 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.006806 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.007048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.007143 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.007382 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.007516 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008204 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008300 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008521 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008615 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008830 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.008924 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009144 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009230 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009451 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009537 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009774 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.009896 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010121 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010210 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010431 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010527 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010736 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.010894 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011064 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011150 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011371 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011457 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011681 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011770 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.011988 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012074 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012298 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012385 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012607 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012695 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012913 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.012999 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013240 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013328 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013544 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013632 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013886 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.013986 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014209 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014305 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014524 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014610 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014839 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.014931 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015152 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015247 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015471 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015564 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015782 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.015868 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016097 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016192 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016406 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016492 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016716 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.016802 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017026 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017121 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017337 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017424 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017647 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017733 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.017982 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018071 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018298 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018385 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018698 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.018929 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019017 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019255 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019341 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019566 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019658 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019873 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.019960 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020203 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020291 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020531 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020628 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020876 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.020963 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021191 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021278 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021531 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021627 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021886 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.021977 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.022203 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.022290 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.022508 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.022610 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.022756 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:46:00.022844 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:46:00.023043 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:46:00.085147 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO dbcounter [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Registered counter for database nova_api Jul 14 15:46:00.085308 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO dbcounter [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Registered counter for database nova_api Jul 14 15:46:00.198048 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_db.sqlalchemy.engines [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.200624 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_db.sqlalchemy.engines [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.204520 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writer thread running {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.207269 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writer thread running {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.261276 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.context [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2ee7a97-dc57-4e4f-9b70-59117f70fb54(cell1) {{(pid=115468) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:46:00.263889 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.context [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2ee7a97-dc57-4e4f-9b70-59117f70fb54(cell1) {{(pid=115467) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:46:00.265184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.266798 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.267600 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.267848 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_concurrency.lockutils [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.269443 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_concurrency.lockutils [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.269703 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.270323 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_concurrency.lockutils [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.271705 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO dbcounter [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Registered counter for database nova_cell0 Jul 14 15:46:00.272479 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_concurrency.lockutils [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.274495 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO dbcounter [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Registered counter for database nova_cell0 Jul 14 15:46:00.275540 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO dbcounter [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Registered counter for database nova_cell1 Jul 14 15:46:00.278312 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO dbcounter [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Registered counter for database nova_cell1 Jul 14 15:46:00.283024 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_db.sqlalchemy.engines [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.284220 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_db.sqlalchemy.engines [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.285608 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_db.sqlalchemy.engines [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.290719 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writer thread running {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.290850 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writer thread running {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.291351 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_db.sqlalchemy.engines [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.292059 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writer thread running {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.433154 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writer thread running {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.436816 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO dbcounter [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Registered counter for database nova_cell0 Jul 14 15:46:00.442017 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO dbcounter [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Registered counter for database nova_cell0 Jul 14 15:46:00.446124 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_db.sqlalchemy.engines [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.450872 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writer thread running {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.451201 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG oslo_db.sqlalchemy.engines [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:46:00.455549 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writer thread running {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:46:00.885663 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: WARNING keystonemiddleware.auth_token [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:46:00.892960 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: WARNING keystonemiddleware.auth_token [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:46:00.919474 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: WARNING keystonemiddleware.auth_token [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:46:00.926778 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: WARNING keystonemiddleware.auth_token [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:46:01.234525 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: WARNING keystonemiddleware.auth_token [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:46:01.240535 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: WARNING keystonemiddleware.auth_token [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:46:01.245840 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555976c979c0 pid: 115468 (default app) Jul 14 15:46:01.247912 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:01.249106 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jul 14 15:46:01.249529 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Thu Jul 14 15:46:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:01.265058 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: WARNING keystonemiddleware.auth_token [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:46:01.271127 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: WARNING keystonemiddleware.auth_token [None req-fc92fe80-a37a-4295-a3a1-727dbbefa7ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:46:01.276904 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555976c979c0 pid: 115467 (default app) Jul 14 15:47:20.406569 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:20.411755 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Jul 14 15:47:20.411755 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:20.421946 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_api:SELECT=3 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:20.423075 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_cell1:SELECT=3 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:20.424063 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_cell0:SELECT=3 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:20.424963 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:21.289578 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-38b39c5b-c177-48ba-8e30-22ce4732bc35 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:21.319453 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-38b39c5b-c177-48ba-8e30-22ce4732bc35 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903135 Jul 14 15:47:21.320177 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 14 15:47:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:23.564357 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:23.565616 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-5340999e-6217-48a2-9b6a-57af5bb398e6 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jul 14 15:47:23.566304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:24.030089 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-c50d26f9-979a-4812-a71e-79ff9558ba91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:24.053722 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:47:24.053722 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: warnings.warn(msg) Jul 14 15:47:24.147240 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-c50d26f9-979a-4812-a71e-79ff9558ba91 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.574088 Jul 14 15:47:24.147840 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:24.162649 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_api:SELECT=3 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:24.163615 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_cell0:SELECT=3 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:24.164337 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_cell1:SELECT=3 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:24.165049 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:24.371650 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-e5ac0c06-ae19-4f78-a5cc-cf582de9495a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:24.374128 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:47:24.374128 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:47:24.511494 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-e5ac0c06-ae19-4f78-a5cc-cf582de9495a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.354492 Jul 14 15:47:24.512363 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 14 15:47:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:26.757471 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-c50d26f9-979a-4812-a71e-79ff9558ba91 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:26.758704 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-c50d26f9-979a-4812-a71e-79ff9558ba91 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Jul 14 15:47:26.764251 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:27.426845 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-ec729e04-ead4-4366-b15e-7700e10b5ad2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:27.446591 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:47:27.446591 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:47:27.550265 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-ec729e04-ead4-4366-b15e-7700e10b5ad2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.784329 Jul 14 15:47:27.558103 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:47:27.564153 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-81c0f214-30e0-4055-ac69-1665b42e9310 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:27.565976 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:47:27.565976 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: warnings.warn(msg) Jul 14 15:47:27.752463 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-81c0f214-30e0-4055-ac69-1665b42e9310 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.193049 Jul 14 15:47:27.753337 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 14 15:47:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:29.975313 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-ec729e04-ead4-4366-b15e-7700e10b5ad2 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:29.976329 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-ec729e04-ead4-4366-b15e-7700e10b5ad2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 14 15:47:29.977442 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:30.374409 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3f130476-02ff-4a15-a15f-dd2980d28354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "name": "ds1G", "id": "d2", "vcpus": 1}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:30.474065 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3f130476-02ff-4a15-a15f-dd2980d28354 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491071 Jul 14 15:47:30.474626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:47:30.487134 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-88cb0d10-6c8d-4dab-8ace-87b90f1e8b78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:30.563354 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-88cb0d10-6c8d-4dab-8ace-87b90f1e8b78 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079987 Jul 14 15:47:30.577901 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 14 15:47:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:32.788599 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3f130476-02ff-4a15-a15f-dd2980d28354 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:32.790752 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3f130476-02ff-4a15-a15f-dd2980d28354 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002618 Jul 14 15:47:32.791152 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:33.259729 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-e6921992-968d-43f2-b3bc-c844f951c84c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:33.365786 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-e6921992-968d-43f2-b3bc-c844f951c84c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.568844 Jul 14 15:47:33.366576 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:33.380183 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-a6d6c0e7-b4cb-4a7e-9785-33dbbdd7c2f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:33.481693 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-a6d6c0e7-b4cb-4a7e-9785-33dbbdd7c2f7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106052 Jul 14 15:47:33.482364 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 14 15:47:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:35.746381 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-e6921992-968d-43f2-b3bc-c844f951c84c admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:35.747412 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-e6921992-968d-43f2-b3bc-c844f951c84c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 14 15:47:35.747813 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:36.189844 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:36.274950 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521144 Jul 14 15:47:36.275986 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:36.288241 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-315a78a5-0cdb-4569-aaaf-b69c6899bf07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:36.448357 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-315a78a5-0cdb-4569-aaaf-b69c6899bf07 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163877 Jul 14 15:47:36.449301 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 14 15:47:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:47:38.672292 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:38.673380 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 14 15:47:38.673783 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:39.131235 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-80539cb5-45ac-4158-8b5a-5483da51b6d9 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:39.154907 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-80539cb5-45ac-4158-8b5a-5483da51b6d9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.475141 Jul 14 15:47:39.155494 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 14 15:47:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:47:41.554905 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:41.555928 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-92c6641e-d6ef-4c05-ae7f-8342093abd89 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 14 15:47:41.556582 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:41.978167 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-e8050245-761a-4cbe-b334-52da6a1c6d61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1, "id": "1"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:42.058082 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-e8050245-761a-4cbe-b334-52da6a1c6d61 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495164 Jul 14 15:47:42.064353 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:42.070993 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-2cabca11-943f-4c34-9aaa-5e1354333889 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:42.152333 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-2cabca11-943f-4c34-9aaa-5e1354333889 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085078 Jul 14 15:47:42.152831 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 14 15:47:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:47:44.363523 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-e8050245-761a-4cbe-b334-52da6a1c6d61 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:44.364834 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-e8050245-761a-4cbe-b334-52da6a1c6d61 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jul 14 15:47:44.365240 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:44.766919 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-5e5d2c1d-c655-4a2e-b7f7-7541bdeecf31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:44.839936 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-5e5d2c1d-c655-4a2e-b7f7-7541bdeecf31 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468900 Jul 14 15:47:44.840608 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:47:44.852603 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-a2eac629-dddb-494d-ab09-5fae6dcb9a04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:44.964220 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-a2eac629-dddb-494d-ab09-5fae6dcb9a04 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115265 Jul 14 15:47:44.964804 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 14 15:47:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:47.219385 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-5e5d2c1d-c655-4a2e-b7f7-7541bdeecf31 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:47.220445 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-5e5d2c1d-c655-4a2e-b7f7-7541bdeecf31 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 14 15:47:47.220907 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:47.563205 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-148d7423-2bfe-4556-9d97-2bafdebd090d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 40}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:47.662544 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-148d7423-2bfe-4556-9d97-2bafdebd090d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435211 Jul 14 15:47:47.663104 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:47.675651 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-25d42d0c-deac-4d16-b320-9f3e5c5bea25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:47.763355 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-25d42d0c-deac-4d16-b320-9f3e5c5bea25 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091298 Jul 14 15:47:47.763982 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 14 15:47:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:50.016116 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-148d7423-2bfe-4556-9d97-2bafdebd090d admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:50.017134 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-148d7423-2bfe-4556-9d97-2bafdebd090d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 14 15:47:50.017536 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:50.468354 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-93af5b7f-de64-4d9e-b683-fd7254eeb862 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:50.542734 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-93af5b7f-de64-4d9e-b683-fd7254eeb862 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518688 Jul 14 15:47:50.543626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:47:50.556533 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-ea2aa1b7-42f1-4365-aa7d-b0eafc568656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:50.707858 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-ea2aa1b7-42f1-4365-aa7d-b0eafc568656 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155999 Jul 14 15:47:50.708453 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 14 15:47:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:52.930541 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-93af5b7f-de64-4d9e-b683-fd7254eeb862 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:52.932458 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-93af5b7f-de64-4d9e-b683-fd7254eeb862 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002452 Jul 14 15:47:52.932949 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:53.379254 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:53.481207 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.542175 Jul 14 15:47:53.489681 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 14 15:47:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:47:53.495252 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-53dc7f21-c1d7-4b7b-afc5-fc62a7c7d327 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:53.503625 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:53.625454 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-53dc7f21-c1d7-4b7b-afc5-fc62a7c7d327 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134117 Jul 14 15:47:53.626083 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 14 15:47:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:14.048741 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:14.049875 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 14 15:48:14.050282 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:14.437657 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-114356ec-2522-4208-8e6d-e09d127799e8 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:14.454328 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-114356ec-2522-4208-8e6d-e09d127799e8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398139 Jul 14 15:48:14.454866 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 14 15:48:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:48:15.514184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:15.515203 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-da1ee75b-fd26-4496-a26a-5bf8a088362a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 14 15:48:15.515602 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:16.035688 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-51271fe0-510b-48f9-b78d-0e7b2a8a5d47 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.042056 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.wsgi [None req-51271fe0-510b-48f9-b78d-0e7b2a8a5d47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-51271fe0-510b-48f9-b78d-0e7b2a8a5d47 admin admin] Request method failure captured: Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept: application/json Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept-Encoding: gzip, deflate Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Connection: keep-alive Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Content-Length: 0 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Host: 10.222.0.47 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-System-Scope: None Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: User-Agent: python-novaclient Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Auth-Token: gAAAAABi0Dq_uVJwUo2LqcJrUXTSgweqR1g60TWJzXOa3Eb_d0GMp3OD1Csnso2oAaB4juOIgnmRzXSCoyEMe98yXnG9QaTAII2hCwv5YWbyPddGrldcYxxEDqsduNtFaBkN2GqppGazMSOGHgVlcOkR5Z-axiIUhU0xyvxeL05U9x0Oh5HiZeQ Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Id: None Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Name: None Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Identity-Status: Confirmed Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Is-Admin-Project: True Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Id: default Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Name: Default Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Name: admin Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Role: admin,reader,member Jul 14 15:48:16.045320 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Roles: admin,reader,member Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant: admin Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Name: admin Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User: admin Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Id: default Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Name: Default Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Name: admin Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: method: > Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: exception: Flavor 42 could not be found. Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: action_args: {'id': '42'} Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:16.047140 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:16.049226 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.050613 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-51271fe0-510b-48f9-b78d-0e7b2a8a5d47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:16.052189 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-51271fe0-510b-48f9-b78d-0e7b2a8a5d47 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394056 Jul 14 15:48:16.052189 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 14 15:48:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:16.056787 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-ab720433-c6b8-43d4-b1ac-2c11a8a09fbb admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.059718 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.083327 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-ab720433-c6b8-43d4-b1ac-2c11a8a09fbb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030423 Jul 14 15:48:16.083869 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:48:16.094000 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-f1b593ce-d579-4032-9f8c-ceb08a41d882 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.115420 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-f1b593ce-d579-4032-9f8c-ceb08a41d882 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024907 Jul 14 15:48:16.115952 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:48:16.125374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f7f3b327-1af7-49ad-83c7-4c6441a5a952 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.131099 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.wsgi [None req-f7f3b327-1af7-49ad-83c7-4c6441a5a952 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f7f3b327-1af7-49ad-83c7-4c6441a5a952 admin admin] Request method failure captured: Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept: application/json Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept-Encoding: gzip, deflate Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Connection: keep-alive Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Content-Length: 0 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Host: 10.222.0.47 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-System-Scope: None Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: User-Agent: python-novaclient Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Auth-Token: gAAAAABi0Dq_uVJwUo2LqcJrUXTSgweqR1g60TWJzXOa3Eb_d0GMp3OD1Csnso2oAaB4juOIgnmRzXSCoyEMe98yXnG9QaTAII2hCwv5YWbyPddGrldcYxxEDqsduNtFaBkN2GqppGazMSOGHgVlcOkR5Z-axiIUhU0xyvxeL05U9x0Oh5HiZeQ Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Id: None Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Name: None Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Identity-Status: Confirmed Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Is-Admin-Project: True Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Id: default Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Name: Default Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Name: admin Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Role: admin,reader,member Jul 14 15:48:16.134401 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Roles: admin,reader,member Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant: admin Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Name: admin Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User: admin Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Id: default Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Name: Default Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Name: admin Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: method: > Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: exception: Flavor 42 could not be found. Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: action_args: {'id': '42'} Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:16.143828 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:16.144827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:16.146138 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f7f3b327-1af7-49ad-83c7-4c6441a5a952 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:16.147898 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-f7f3b327-1af7-49ad-83c7-4c6441a5a952 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014224 Jul 14 15:48:16.147898 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:17.104255 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-f1b593ce-d579-4032-9f8c-ceb08a41d882 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.105274 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-f1b593ce-d579-4032-9f8c-ceb08a41d882 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 14 15:48:17.105804 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:17.627554 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-cc987f4e-aae4-4922-bd4f-53c851ff8725 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.632830 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.wsgi [None req-cc987f4e-aae4-4922-bd4f-53c851ff8725 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-cc987f4e-aae4-4922-bd4f-53c851ff8725 admin admin] Request method failure captured: Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept: application/json Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept-Encoding: gzip, deflate Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Connection: keep-alive Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Content-Length: 0 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Host: 10.222.0.47 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-System-Scope: None Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: User-Agent: python-novaclient Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Auth-Token: gAAAAABi0DrAAmiTBDazpplPjWn_HWixY0x9vGxkUkF5HUypZcQC6EGsiPJURIq3HI4xc60aSrJ-bqCHB4ENgQ_UNaciHmwuCJwqU-tHP2YcAqARiSZVhPEU7A52jR3zXcBfcLhcRdAXqJHpjuql93MfBITgffUg4jc4VaUi37SGH38EE6ORIgU Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Id: None Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Name: None Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Identity-Status: Confirmed Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Is-Admin-Project: True Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Id: default Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Name: Default Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Name: admin Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Role: admin,reader,member Jul 14 15:48:17.634374 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Roles: admin,reader,member Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant: admin Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Name: admin Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User: admin Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Id: default Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Name: Default Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Name: admin Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: method: > Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: exception: Flavor 84 could not be found. Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: action_args: {'id': '84'} Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:17.635933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:17.637009 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.638450 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-cc987f4e-aae4-4922-bd4f-53c851ff8725 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:17.639794 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-cc987f4e-aae4-4922-bd4f-53c851ff8725 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389193 Jul 14 15:48:17.639794 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:17.645278 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-ed97c349-828b-4f6e-a241-9d3bb8322234 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.659266 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-ed97c349-828b-4f6e-a241-9d3bb8322234 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017560 Jul 14 15:48:17.659799 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:48:17.669608 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-64299683-4566-415f-b0ad-7f6f53c0c066 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.683407 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-64299683-4566-415f-b0ad-7f6f53c0c066 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017313 Jul 14 15:48:17.683953 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:48:17.692876 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-36cde7da-bbed-4bfa-8c75-2f7f7da6a184 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.698051 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.wsgi [None req-36cde7da-bbed-4bfa-8c75-2f7f7da6a184 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-36cde7da-bbed-4bfa-8c75-2f7f7da6a184 admin admin] Request method failure captured: Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept: application/json Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept-Encoding: gzip, deflate Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Connection: keep-alive Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Content-Length: 0 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Host: 10.222.0.47 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-System-Scope: None Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: User-Agent: python-novaclient Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Auth-Token: gAAAAABi0DrAAmiTBDazpplPjWn_HWixY0x9vGxkUkF5HUypZcQC6EGsiPJURIq3HI4xc60aSrJ-bqCHB4ENgQ_UNaciHmwuCJwqU-tHP2YcAqARiSZVhPEU7A52jR3zXcBfcLhcRdAXqJHpjuql93MfBITgffUg4jc4VaUi37SGH38EE6ORIgU Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Id: None Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Name: None Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Identity-Status: Confirmed Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Is-Admin-Project: True Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Id: default Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Name: Default Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Name: admin Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Role: admin,reader,member Jul 14 15:48:17.699531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Roles: admin,reader,member Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant: admin Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Name: admin Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User: admin Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Id: default Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Name: Default Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Name: admin Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: method: > Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: exception: Flavor 84 could not be found. Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: action_args: {'id': '84'} Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:17.701116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:17.702402 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:17.703787 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-36cde7da-bbed-4bfa-8c75-2f7f7da6a184 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:17.705033 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-36cde7da-bbed-4bfa-8c75-2f7f7da6a184 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011518 Jul 14 15:48:17.705033 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 15:48:18.658206 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-64299683-4566-415f-b0ad-7f6f53c0c066 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:18.659212 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-64299683-4566-415f-b0ad-7f6f53c0c066 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 14 15:48:18.659606 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:19.181340 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-18409b4a-7374-4300-9ec9-bb687e7018bb admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:19.187067 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.wsgi [None req-18409b4a-7374-4300-9ec9-bb687e7018bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-18409b4a-7374-4300-9ec9-bb687e7018bb admin admin] Request method failure captured: Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept: application/json Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Accept-Encoding: gzip, deflate Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Connection: keep-alive Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Content-Length: 0 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Host: 10.222.0.47 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Openstack-System-Scope: None Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: User-Agent: python-novaclient Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Auth-Token: gAAAAABi0DrCEuZLb_uahxZcop19pWS0qXbsqapk8gZWwCfWxcXKByBNvTMUMb287jtrjoZ5zBauxAcbMb2ALwAZui_viFTOSmpWZ06UoG1Os3oPpuayC6USnq8wQ8gn3MwImrmol4m8yWJDUjhQOwXP1Y3wLe9fNMxffaoyVCmRKUKh4Uf4uY8 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Id: None Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Domain-Name: None Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Identity-Status: Confirmed Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Is-Admin-Project: True Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Id: default Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Domain-Name: Default Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Project-Name: admin Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Role: admin,reader,member Jul 14 15:48:19.188577 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Roles: admin,reader,member Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant: admin Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-Tenant-Name: admin Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User: admin Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Id: default Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Domain-Name: Default Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: X-User-Name: admin Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: method: > Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: exception: Flavor 451 could not be found. Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: action_args: {'id': '451'} Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:19.190231 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:19.191194 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.192324 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-18409b4a-7374-4300-9ec9-bb687e7018bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:19.193391 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-18409b4a-7374-4300-9ec9-bb687e7018bb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394265 Jul 14 15:48:19.193391 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:48:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:19.199485 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-c7baf496-9207-4148-93cc-2b3759210d35 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:19.213330 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-c7baf496-9207-4148-93cc-2b3759210d35 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017435 Jul 14 15:48:19.213870 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:48:19.222902 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:19.238311 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018907 Jul 14 15:48:19.239150 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 14 15:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:48:19.248168 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f5e4c82c-6d4c-4ff4-8be0-6ab79bdc133b admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:19.253357 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.wsgi [None req-f5e4c82c-6d4c-4ff4-8be0-6ab79bdc133b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f5e4c82c-6d4c-4ff4-8be0-6ab79bdc133b admin admin] Request method failure captured: Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept: application/json Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Accept-Encoding: gzip, deflate Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Connection: keep-alive Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Content-Length: 0 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Host: 10.222.0.47 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-Api-Version: compute 2.90 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Openstack-System-Scope: None Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: User-Agent: python-novaclient Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Auth-Token: gAAAAABi0DrCEuZLb_uahxZcop19pWS0qXbsqapk8gZWwCfWxcXKByBNvTMUMb287jtrjoZ5zBauxAcbMb2ALwAZui_viFTOSmpWZ06UoG1Os3oPpuayC6USnq8wQ8gn3MwImrmol4m8yWJDUjhQOwXP1Y3wLe9fNMxffaoyVCmRKUKh4Uf4uY8 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Id: None Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Domain-Name: None Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Identity-Status: Confirmed Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Is-Admin-Project: True Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Id: default Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Domain-Name: Default Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Project-Name: admin Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Role: admin,reader,member Jul 14 15:48:19.256666 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Roles: admin,reader,member Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d8c317cfa3fe4e0aa6bdd74dbc68a586", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d8c317cfa3fe4e0aa6bdd74dbc68a586"}]}] Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant: admin Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Id: d8c317cfa3fe4e0aa6bdd74dbc68a586 Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-Tenant-Name: admin Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User: admin Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Id: default Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Domain-Name: Default Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Id: d2ffbc8434d34115805dcbc2a72dc671 Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: X-User-Name: admin Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: method: > Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: exception: Flavor 451 could not be found. Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: action_args: {'id': '451'} Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:19.258304 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:19.259287 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: ERROR nova.api.openstack.wsgi Jul 14 15:48:19.260547 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-f5e4c82c-6d4c-4ff4-8be0-6ab79bdc133b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:19.261763 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-f5e4c82c-6d4c-4ff4-8be0-6ab79bdc133b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013358 Jul 14 15:48:19.261763 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:48:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 15:48:20.222215 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:20.223247 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 14 15:48:20.223626 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:20.745521 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-07e913e3-1a0b-4581-8d46-339526ed7014 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:20.815007 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-07e913e3-1a0b-4581-8d46-339526ed7014 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453260 Jul 14 15:48:20.815557 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 14 15:48:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:48:21.791000 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:21.792012 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 14 15:48:21.792406 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:22.320194 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-9df1c740-a1d1-44e8-a285-79b2add3ce7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:22.453404 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-9df1c740-a1d1-44e8-a285-79b2add3ce7c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.525514 Jul 14 15:48:22.453981 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 14 15:48:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:23.429345 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:23.430398 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jul 14 15:48:23.430799 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:23.951067 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-ab63f12d-a458-4a5e-b384-23ccc7cbe2b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:24.013124 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-ab63f12d-a458-4a5e-b384-23ccc7cbe2b5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444014 Jul 14 15:48:24.013673 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 14 15:48:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:24.980116 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:24.981123 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 14 15:48:24.981531 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:25.504926 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-1927d4db-10c7-4d9f-a6a1-655e2b3b98cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:25.603405 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-1927d4db-10c7-4d9f-a6a1-655e2b3b98cd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483225 Jul 14 15:48:25.603955 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 14 15:48:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:26.573777 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:26.574818 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 14 15:48:26.575236 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:27.093376 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-bcf9a4a6-6447-47c3-9ade-a75911f3448e admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:27.112787 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-bcf9a4a6-6447-47c3-9ade-a75911f3448e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400369 Jul 14 15:48:27.113323 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Thu Jul 14 15:48:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:18.768348 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:18.769355 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-60320c7f-c05e-4b64-8716-83230d2733c0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 14 15:49:18.769756 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 14 15:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:18.780613 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:19.279924 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-b9377cd3-9a3a-401a-9381-a802b19b6496 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.299371 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-b9377cd3-9a3a-401a-9381-a802b19b6496 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.523198 Jul 14 15:49:19.299902 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 14 15:49:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:49:19.321636 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG dbcounter [-] [115467] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:19.325317 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-0bdc527a-cba6-496a-86f9-9a0a11b11b90 admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.332718 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-0bdc527a-cba6-496a-86f9-9a0a11b11b90 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012487 Jul 14 15:49:19.334218 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Thu Jul 14 15:49:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:19.344499 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-d1a92736-139e-4833-995d-85622da286b8 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.352933 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-d1a92736-139e-4833-995d-85622da286b8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Jul 14 15:49:19.353494 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Thu Jul 14 15:49:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:19.365491 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.373380 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012157 Jul 14 15:49:19.373926 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Thu Jul 14 15:49:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:19.385146 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-3363285f-9cd1-45ba-9cc7-07b1e4b03276 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.392638 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-3363285f-9cd1-45ba-9cc7-07b1e4b03276 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010941 Jul 14 15:49:19.393149 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Thu Jul 14 15:49:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:54.022831 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:54.023853 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 15:52:54.024254 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:54.164535 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_api:SELECT=6 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:54.324890 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:54.326098 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:54.326098 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:52:54.327322 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:54.327769 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:54.328550 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:54.328981 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:54.362615 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-8f112bf8-8a22-48e9-99b9-69430e528ff4 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199521 Jul 14 15:52:54.363235 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:52:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:52:55.191789 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:55.192881 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 14 15:52:55.193283 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:55.382003 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:55.383184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:55.383184 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:52:55.384367 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:55.384827 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:55.385614 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:55.386077 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:55.405516 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-cf9b9e19-b8ef-4b72-b6bc-a72cfd5a2715 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074157 Jul 14 15:52:55.407145 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:52:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:53:06.635305 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:06.636325 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 14 15:53:06.639552 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:53:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:06.780914 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_cell0:SELECT=4 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:06.781587 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_cell1:SELECT=4 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:06.782293 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG dbcounter [-] [115468] Writing DB stats nova_api:SELECT=8 {{(pid=115468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:06.831028 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:06.833369 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:53:06.833369 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:53:06.833369 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:06.833769 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:06.834575 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:06.834999 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:06.859653 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-0c8fbfc7-8479-46f9-885a-798b216097ab admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083308 Jul 14 15:53:06.862019 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:53:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:53:07.693233 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: DEBUG nova.api.openstack.wsgi [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] Calling method '>' {{(pid=115467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:07.694276 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: INFO nova.api.openstack.requestlog [None req-3b944b59-278f-4ef1-af57-870d483ffeac admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 14 15:53:07.694671 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: [pid: 115467|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 14 15:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:07.884233 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG nova.api.openstack.wsgi [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] Calling method '>' {{(pid=115468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:07.885403 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:53:07.885403 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: warnings.warn(msg) Jul 14 15:53:07.886668 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:07.887113 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:07.887936 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:07.888364 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: DEBUG oslo_concurrency.lockutils [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:07.910467 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: INFO nova.api.openstack.requestlog [None req-7e7825cd-818f-480e-853f-02ed99f1d34d admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077531 Jul 14 15:53:07.911003 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: [pid: 115468|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 14 15:53:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:54:05.632854 dv-cinder-837164-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 15:54:05.633467 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: Thu Jul 14 15:54:05 2022 - graceful shutdown triggered... Jul 14 15:54:05.634005 dv-cinder-837164-3-iscsi devstack@n-api.service[115467]: Gracefully killing worker 1 (pid: 115467)... Jul 14 15:54:05.634562 dv-cinder-837164-3-iscsi devstack@n-api.service[115468]: Gracefully killing worker 2 (pid: 115468)... Jul 14 15:54:06.634540 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: worker 1 buried after 1 seconds Jul 14 15:54:06.634995 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: worker 2 buried after 1 seconds Jul 14 15:54:06.634995 dv-cinder-837164-3-iscsi devstack@n-api.service[115466]: goodbye to uWSGI. Jul 14 15:54:06.636190 dv-cinder-837164-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 15:54:06.636764 dv-cinder-837164-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 15:54:06.639618 dv-cinder-837164-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:54:06.651156 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:54:06 2022] *** Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: nodename: dv-cinder-837164-3-iscsi Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: machine: x86_64 Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: clock source: unix Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: pcre jit disabled Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: detected number of CPU cores: 4 Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: current working directory: / Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:54:06.653191 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: your processes number limit is 47680 Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: your memory page size is 4096 bytes Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: detected max file descriptor number: 2048 Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: lock engine: pthread robust mutexes Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: thunder lock: enabled Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:54:06.653977 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:54:06.699954 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: Python main interpreter initialized at 0x561e270909c0 Jul 14 15:54:06.699954 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: python threads support enabled Jul 14 15:54:06.699954 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: your server socket listen backlog is limited to 100 connections Jul 14 15:54:06.699954 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:54:06.700418 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:54:06.700418 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: *** Operational MODE: preforking *** Jul 14 15:54:06.700679 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:54:06.700679 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: spawned uWSGI master process (pid: 129973) Jul 14 15:54:06.700903 dv-cinder-837164-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:54:06.702019 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: spawned uWSGI worker 1 (pid: 129991, cores: 1) Jul 14 15:54:06.702314 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: spawned uWSGI worker 2 (pid: 129992, cores: 1) Jul 14 15:54:06.702710 dv-cinder-837164-3-iscsi devstack@n-api.service[129973]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:54:07.363381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:54:07.383927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:54:08.566860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:54:08.566860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: from cryptography.utils import int_from_bytes Jul 14 15:54:08.567474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:54:08.567474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: from cryptography.utils import int_from_bytes Jul 14 15:54:08.579452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:54:08.579452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: from cryptography.utils import int_from_bytes Jul 14 15:54:08.579982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:54:08.579982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: from cryptography.utils import int_from_bytes Jul 14 15:54:10.896794 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:54:10.897982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:54:10.897982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:54:10.897982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:54:10.898222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:54:10.898528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.898892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.899225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.899549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.899910 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.900198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.900587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.900845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.901181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.901448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.901769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.902138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837164-3-iscsi {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.902469 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.902784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.903104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.903442 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.903741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.904073 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.904409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.904896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.906309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.906309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.906309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.906309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837164-3-iscsi {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.911736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.912312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.912312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.912448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.912886 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.913054 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.913342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.913664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.914016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.914332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.915184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.915439 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.915753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.916084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.916414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.916750 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.917002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.917257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.917584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.917939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.918260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.918599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.918888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.919203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.919521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.919831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.920143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.920456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.920784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.921109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.921438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.921753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.922111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.922266 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:54:10.922756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.922949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:54:10.923113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.923265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:54:10.923409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.923563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:54:10.923765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.923921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:54:10.924093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.924249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.924420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.924566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.924725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.924875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.925848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926476 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.926912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.927083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.927491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.927648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.927798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.927951 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837164-3-iscsi {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.928819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.929107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.929268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.929425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.929614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.929771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.931747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.931923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.932855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933468 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.933983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934428 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934730 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.934885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.935029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.935437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.935607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.935761 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.935922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.936078 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.936228 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837164-3-iscsi {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.936841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.936996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.937746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.938046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.938470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.938646 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.938799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.938952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.939106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.939496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.939690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.939846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.940835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.941553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.941740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.941915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.942072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.942216 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.942360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.942714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.942874 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.943028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.945579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.945763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.945981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.946783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947219 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947670 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.947976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948625 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.948965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.949109 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.949260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.949403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.949631 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.949787 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.949983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.950149 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.950300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.950453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.950780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.950945 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.950945 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.951251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.951752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.951921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.952066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.952216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.952360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.952520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.952867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.953034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.953188 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.953339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.953493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.953637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.953788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.954025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.954181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.954324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.954324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.954603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.954603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.955213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.955372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.955521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.955673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.955824 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.955983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.956134 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.956289 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.956432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.956575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.956718 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.956874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.957036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.957187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.957331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.957331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.957331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.957749 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.957916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.958073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.958216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.958360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.958508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.958669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.958823 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.958966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.959116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.959258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.959420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.959566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.959707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.959856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.960014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.960168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.960168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.960462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.960615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.960938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.961097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.961893 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.962063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.962216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.962360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.962502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.962644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.963051 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.963220 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.963375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.963519 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.963667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.963829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.963972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.964146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.964346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.964492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.964646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.964835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.964998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.965141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.965292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.965442 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.965586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.965734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.965952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.966110 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.966253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.966403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.966547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.966688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.966883 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.967033 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.967175 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.967349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.967624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.967783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.967927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.968079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.968222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.968384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.968546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.968700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.968700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.968983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.969134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.969277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.969277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.969571 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.969722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.969722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.970055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.970222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.970375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.970526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.970678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.970822 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.971132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.971294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.971445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.971588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.971996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.972225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.972385 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.972542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.972686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.972829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.972990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.973302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.973463 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.973616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.973770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.973956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.974111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.974262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.974411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.974581 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.974733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.974877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.975026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.975169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.975421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.975579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.975731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.975887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.976039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.976190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.976343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.976494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.976648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:54:10.976791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.977445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.977614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.977856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.978992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.979979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.980137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.980328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.980483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.980763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.980942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.981235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.981385 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.981540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.981684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982507 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.982804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.983083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.983327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.983568 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.983729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.983891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984194 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984337 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984488 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.984938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985088 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985674 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.985941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986842 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.986992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.987981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988292 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988436 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.988879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989029 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989313 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989463 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.989957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990113 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.990998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.991172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.991460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.991620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.991765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.991915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.992268 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.992509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.993326 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.993578 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.993833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.993988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.994889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995042 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995640 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.995933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996088 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.996840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997591 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.997997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.998218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.998367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.998510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.998733 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.998903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:10.999957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000118 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000263 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000404 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000558 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.000983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.001135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.001304 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.001681 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.001870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.002035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.002393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.002624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.002782 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.002939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.003084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.003236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.003387 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.003566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.003810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.004951 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005107 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.005874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006321 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.006885 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.007860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008220 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008611 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008764 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.008908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009051 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.009982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010288 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.010953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.011163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.011311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.011472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.011776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.011934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.012079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.012233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.012619 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.013690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.013990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.014260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.014413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.014567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.014736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.014920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.015935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016515 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.016964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.017875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.018869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019319 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.019908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.020905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021365 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.021648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.022131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.022277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.022419 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.022793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.023168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.023356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.023511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.023705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.024605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.024760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.024904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.025479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026294 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.026830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027256 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.027978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.028957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029572 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029665 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029757 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029858 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.029957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.030953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031228 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031762 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.031855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032219 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032304 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032592 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.032936 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033029 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.033966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.034077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.034172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.034265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.034359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.034467 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.035911 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036250 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036368 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.036936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037854 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.037984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.038981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.039095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.039204 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.039326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.039510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040279 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040398 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040515 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040626 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.040968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041194 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.041913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.042039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.042377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.042535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.042673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.042817 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043020 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.043955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044186 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.044789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.045952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046345 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046745 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.046873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047007 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047792 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.047909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048137 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.048912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.049470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.051797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.052173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.052779 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.052906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053230 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.053879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054478 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.054939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.055583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.055722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.055896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056133 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.056979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057571 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057750 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.057851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.058036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.058132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.058218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.064677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.064812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.064916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065422 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065622 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.065788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066750 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.066920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067680 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.067900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068024 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068758 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068852 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.068937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069020 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069601 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.069916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070824 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.070915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071428 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.071941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072024 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072212 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072552 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.072882 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073428 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073801 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.073953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074042 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074839 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.074925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075451 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075541 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.075923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076007 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076275 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076632 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.076911 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.077983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.078947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.079820 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080149 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080354 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080680 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.080972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.081959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082269 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082880 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.082975 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083593 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.083928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084269 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.084939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.085150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.085250 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.085466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.085569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.085804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.086023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.086151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.086780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.086995 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.087967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088711 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.088919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.089927 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.090914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091118 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091218 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.091865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.092936 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.093795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099812 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.099952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100481 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.100885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.101897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.102056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.102672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.102786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.102915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.103930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104594 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.104950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105726 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.105923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106373 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106626 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.106964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107388 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.107833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108315 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108851 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.108935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109391 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.109940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110031 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110207 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.110967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111368 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111458 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111458 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.111932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.112034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.112241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.112391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.112560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.112910 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.113255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.113494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.113861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114598 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114772 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.114895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115548 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.115867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.116991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.117132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.117339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.117547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.117669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.117971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118597 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118794 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.118901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119761 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.119925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.120918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.121910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.122879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123368 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123522 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123691 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.123853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124232 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124562 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.124992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.125210 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.125333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.125551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.125776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.125946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.126866 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.127843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128041 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128671 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.128986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129417 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129715 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.129961 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.130902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131220 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.131890 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132307 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.132947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133291 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133510 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.133988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134166 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.134899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135114 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135426 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135525 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.135843 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136386 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.136817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137043 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.137810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138043 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.138926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.139924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140384 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140562 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140670 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.140969 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.141923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142754 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.142844 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143066 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.143998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.144996 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145640 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.145970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.146948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147715 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.147820 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.148024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.148117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.148327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.148442 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.148638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.149276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.149464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.149577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.149773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.149885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.150839 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151167 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.151998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.152926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153021 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.153939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154207 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.154875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155397 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155507 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.155803 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156153 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156697 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.156821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.157983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.158937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159252 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.159894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160801 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.160901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161760 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.161900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162422 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.162883 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163050 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.163994 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.164094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.164249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:54:11.164361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.165150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.165466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.165783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.166119 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.166434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.166748 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.167061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.167382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.167730 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.168056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.168407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.168726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.169074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.169446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.169766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.170100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.170414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.170737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.171073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.171389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.171703 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.172146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.172464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.172785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.173111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.173423 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.173749 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.174115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.174430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.174756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.175070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.175404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.175750 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.176087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.176418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.176730 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.177039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.177616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.177953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.178278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.178589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.178895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.179205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.179516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.179822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.180166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.180473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.180781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.181091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.181395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.181701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.182030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.182338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.182645 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.182956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.183264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.183573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.183885 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.184187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.184493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.184796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.185145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.185492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.185808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.186158 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.186477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.186804 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.187117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.187453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.187779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.188104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.188418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.188752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.189065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.189383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.189702 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.190050 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.190363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.190675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.191014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.191347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.191653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.191986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.192311 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.192636 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.192956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.193272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.193605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.193948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.194267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.194579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.194898 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.195213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.195527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.195878 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.196203 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.196513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.196831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.197168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.197499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.197812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.198162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.198491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.198850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.199167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.199516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.199849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.200167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.200484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.200792 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:54:11.201038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:54:11.317657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO dbcounter [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Registered counter for database nova_api Jul 14 15:54:11.338015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_db.sqlalchemy.engines [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.344508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writer thread running {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.353615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO dbcounter [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Registered counter for database nova_api Jul 14 15:54:11.373005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.379459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writer thread running {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.401600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.context [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2ee7a97-dc57-4e4f-9b70-59117f70fb54(cell1) {{(pid=129992) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:54:11.405688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.407304 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.408123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.410178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.412159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO dbcounter [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Registered counter for database nova_cell0 Jul 14 15:54:11.416707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO dbcounter [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Registered counter for database nova_cell1 Jul 14 15:54:11.424245 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_db.sqlalchemy.engines [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.426465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_db.sqlalchemy.engines [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.431894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writer thread running {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.436921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.context [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2ee7a97-dc57-4e4f-9b70-59117f70fb54(cell1) {{(pid=129991) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:54:11.441049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.442682 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.443502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:11.445492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:11.447516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO dbcounter [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Registered counter for database nova_cell0 Jul 14 15:54:11.451556 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO dbcounter [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Registered counter for database nova_cell1 Jul 14 15:54:11.458921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.460701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.467018 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writer thread running {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.468565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writer thread running {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.570273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writer thread running {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.580430 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO dbcounter [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Registered counter for database nova_cell0 Jul 14 15:54:11.587259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_db.sqlalchemy.engines [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.591871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writer thread running {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.632064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO dbcounter [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Registered counter for database nova_cell0 Jul 14 15:54:11.641014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:54:11.645715 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writer thread running {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:54:11.917185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: WARNING keystonemiddleware.auth_token [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:54:11.924461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: WARNING keystonemiddleware.auth_token [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:54:11.973559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: WARNING keystonemiddleware.auth_token [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:54:11.980968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: WARNING keystonemiddleware.auth_token [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:54:12.269655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: WARNING keystonemiddleware.auth_token [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:54:12.275699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: WARNING keystonemiddleware.auth_token [None req-d498f9da-2f79-4794-bcf3-f5466c3c465d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:54:12.282407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e270909c0 pid: 129992 (default app) Jul 14 15:54:12.329003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: WARNING keystonemiddleware.auth_token [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:54:12.334988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: WARNING keystonemiddleware.auth_token [None req-f1f528ab-9b3a-4d84-9d56-678b7571bb28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:54:12.341179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e270909c0 pid: 129991 (default app) Jul 14 15:54:54.707992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:54.708525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:54.709407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:54.710249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:55.704287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7df05498-550a-4d19-9b5b-8e6b589185aa tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Action: 'create', calling method: .version_select at 0x7f34055cdc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-37976034", "metadata": {"Type": "work"}}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:57.906339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7df05498-550a-4d19-9b5b-8e6b589185aa tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.218021 Jul 14 15:54:57.907326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 14 15:54:54 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3221 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 15:54:58.485017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-14e3d874-8b77-435d-8434-e5be6aef0366 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f3405687790>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:58.516038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:58.517129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:58.518265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:58.519231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:58.790251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-14e3d874-8b77-435d-8434-e5be6aef0366 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 200 len: 351 microversion: 2.1 time: 0.873929 Jul 14 15:54:58.790842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 15:54:57 2022] GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 351 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:59.805783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-39d53b76-3648-4b0f-896c-4b6749f05147 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f340549ca60>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:59.920795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-39d53b76-3648-4b0f-896c-4b6749f05147 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 200 len: 352 microversion: 2.1 time: 0.120294 Jul 14 15:54:59.928413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 15:54:59 2022] GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:59.935681 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d668bb37-7d0e-4596-b515-340b7ffdbe2d tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f34054d7ca0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:00.110026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d668bb37-7d0e-4596-b515-340b7ffdbe2d tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 200 len: 352 microversion: 2.1 time: 0.179399 Jul 14 15:55:00.110584 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 15:54:59 2022] GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:00.128081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b58a72f7-7209-44cc-84aa-a555b846da9c tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f340549cca0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:01.140190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b58a72f7-7209-44cc-84aa-a555b846da9c tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 202 len: 0 microversion: 2.1 time: 1.015653 Jul 14 15:55:01.140865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 15:55:00 2022] DELETE /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:55:01.153539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3afa436f-1625-4db8-a4a1-757706b3b009 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f34054d7dc0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:01.718127 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3afa436f-1625-4db8-a4a1-757706b3b009 tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 200 len: 351 microversion: 2.1 time: 0.560530 Jul 14 15:55:01.718127 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 15:55:01 2022] GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 351 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:02.722270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6668cb23-bd04-4dbe-9e0c-f1008f4207ec tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Calling method '.version_select at 0x7f34054b51f0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:02.792612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-6668cb23-bd04-4dbe-9e0c-f1008f4207ec tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] HTTP exception thrown: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6668cb23-bd04-4dbe-9e0c-f1008f4207ec tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Request method failure captured: Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 HTTP/1.1 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxODJt8PCyihVA819i2KrXBk-B5piW8PLNKmyeS8OS8IeBLmyHVZ0TjkqocjOH9x9KqAPwuG2NMlps6C7emV5G2YO6SO0cjHsBePCIPsmcN3wo1zYM9c-P37UYJPXk2A0LieOBRSSlI1rzII_F5AlfQwTCWszLUa8l35nUBoPkq_HM Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 66a4209b352d49e68dcbc249a7109329 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesGetTestJSON-551797583 Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:55:02.796837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/66a4209b352d49e68dcbc249a7109329"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_66a4209b352d49e68dcbc249a7109329", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/66a4209b352d49e68dcbc249a7109329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/66a4209b352d49e68dcbc249a7109329"}]}] Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesGetTestJSON-551797583 Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 66a4209b352d49e68dcbc249a7109329 Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesGetTestJSON-551797583 Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesGetTestJSON-551797583-project Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: f24bf4773a514a8ba237fc6cc609ab2f Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesGetTestJSON-551797583-project Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '6bdf9abd-f03e-468b-9f4c-5b668648d1a7'} Jul 14 15:55:02.798063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. (HTTP 404) (Request-ID: req-4c81de0b-f35b-4e64-8ecc-d83101b8468a) Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:02.798725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:55:02.799800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:55:02.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. Jul 14 15:55:02.801633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:55:02.805034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6668cb23-bd04-4dbe-9e0c-f1008f4207ec tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] Returning 404 to user: Volume 6bdf9abd-f03e-468b-9f4c-5b668648d1a7 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:55:02.806102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6668cb23-bd04-4dbe-9e0c-f1008f4207ec tempest-VolumesGetTestJSON-551797583 tempest-VolumesGetTestJSON-551797583-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7" status: 404 len: 109 microversion: 2.1 time: 0.088157 Jul 14 15:55:02.811064 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 15:55:02 2022] GET /compute/v2.1/os-volumes/6bdf9abd-f03e-468b-9f4c-5b668648d1a7 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:55:05.812286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e8c74029-0baa-40bc-8676-1a29ffb0c4ad tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: .version_select at 0x7f34054874c0>, body: {"keypair": {"name": "tempest-keypair-446542729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzp7QbLsOF/fVGlC0qEvCGhnM248stTYHxYknzx56ed663YnsacKILRxtmizaI4o24lPSQMkHf2uY3cr1WjKUZsaKaepdU51lP7QGWpVfUkjRLEHm+UUpQ3Cqv2ZQGziQ=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:05.972274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-e8c74029-0baa-40bc-8676-1a29ffb0c4ad tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:06.023840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-e8c74029-0baa-40bc-8676-1a29ffb0c4ad tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for user dcdbbbf1b9944b09898fa8731184c845 and project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:06.181459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e8c74029-0baa-40bc-8676-1a29ffb0c4ad tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.711171 Jul 14 15:55:06.182136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 4/8] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:55:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:13.452011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-334993497", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "networks": [{"uuid": "220033a5-93cc-4f63-945c-37d64a019a3d"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:13.601707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e3656202-c4e5-489e-bd76-0254ff714844 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: .version_select at 0x7f3405477700>, body: {"keypair": {"name": "tempest-keypair-1530033389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObpMRN/BIXF04fNbS9AnMrsNqOSjPONSCfVlt+wAGRZvyIZy4sJjjvLvDkhccybd+OB9iPvqED+DB3EbXFWeaDvhi+oOHOvIbIUJjk5b+ZadaN3EeKeOpjGPpSqYCcW9Q=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:13.676978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-e3656202-c4e5-489e-bd76-0254ff714844 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:13.692669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-e3656202-c4e5-489e-bd76-0254ff714844 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:13.815249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] validate_networks() for [('220033a5-93cc-4f63-945c-37d64a019a3d', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:13.832460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e3656202-c4e5-489e-bd76-0254ff714844 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.613010 Jul 14 15:55:13.840105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 5/9] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:55:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:13.848228 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-666892019", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "497f31f1-708e-4d4b-b1f8-f98fa9d7e1e1"}], "security_groups": [{"name": "tempest-securitygroup--2061697738"}], "key_name": "tempest-keypair-446542729", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:14.481989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] validate_networks() for [('497f31f1-708e-4d4b-b1f8-f98fa9d7e1e1', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:15.594640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:15.595255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:15.595683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:15.596108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:15.596638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:15.616824 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:15.618277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:15.619258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:15.619897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:15.658213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Getting quotas for project 73dcc59c5829442da0518976525fe40b. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:15.667370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Getting quotas for user d476a2bec8164b8bbf9a5aaa419a0351 and project 73dcc59c5829442da0518976525fe40b. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:15.725335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:15.736172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:16.047727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ec4f4ed1-78a1-440b-abfc-e967be7d9b4d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.078279 Jul 14 15:55:16.050685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 5/10] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:16.766477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-484943142", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:17.066363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] validate_networks() for [('5a4b02bb-8411-4c20-b73b-d6921ecea2f8', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:18.341263 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:18.345883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:18.346727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:18.347684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:18.348321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:18.369709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:18.371667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:18.373377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:18.374288 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:18.495231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:18.512690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for user dcdbbbf1b9944b09898fa8731184c845 and project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:18.537090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:18.555563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:18.803337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-899ac95a-6db4-4cf4-ba82-1b167fc6595a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.968582 Jul 14 15:55:18.805446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 6/11] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:18.817318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ae283dd7-3e01-4ca9-abb0-1e1db3f76cf7 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:18.818708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ae283dd7-3e01-4ca9-abb0-1e1db3f76cf7 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:19.119538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:19.123253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:19.123253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:19.124366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:19.125787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:19.161930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:19.165497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:19.166632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:19.167238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:19.218797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:19.230297 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for user 81ca45714ee44a549fd002b4aa13973b and project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:19.233154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ae283dd7-3e01-4ca9-abb0-1e1db3f76cf7 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:19.273061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:19.273061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:19.291973 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ae283dd7-3e01-4ca9-abb0-1e1db3f76cf7 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1214 microversion: 2.1 time: 0.484673 Jul 14 15:55:19.295730 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:18 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1214 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:19.502026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4263956a-7a8d-4737-a966-663aaf75e1e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.442702 Jul 14 15:55:19.512394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 6/13] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:19.523011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9de11e19-da1c-49dc-b078-03df6a7876bf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:19.524160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9de11e19-da1c-49dc-b078-03df6a7876bf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:19.828201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9de11e19-da1c-49dc-b078-03df6a7876bf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:19.870662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9de11e19-da1c-49dc-b078-03df6a7876bf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1236 microversion: 2.1 time: 0.354655 Jul 14 15:55:19.885716 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:19 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1236 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:19.901608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5b0803b4-e848-4d91-8856-9f64ea149767 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:19.902654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5b0803b4-e848-4d91-8856-9f64ea149767 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:19.945039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b47a6443-8e0f-4141-bbbc-7c6bde88a2d9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: .version_select at 0x7f3404304ee0>, body: {"keypair": {"name": "tempest-keypair-113778405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHwsoJSvFHFL9zP754OlWQoaft8eWKyGK5hTrKsZeHDdmPShddT4U3Tw7VhL7s4fbvC5dc8Gj/Jka1pl0rzk/RTtdaYOSrC3E/R0PGbt6VQXh+p1F9z0H6dvyctfiQ0w=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:19.994355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-b47a6443-8e0f-4141-bbbc-7c6bde88a2d9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:20.010403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-b47a6443-8e0f-4141-bbbc-7c6bde88a2d9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for user 95c6d7130d6c4ae4b8460807e6820ef1 and project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:20.108933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5b0803b4-e848-4d91-8856-9f64ea149767 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:20.119399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5b0803b4-e848-4d91-8856-9f64ea149767 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1221 microversion: 2.1 time: 0.231109 Jul 14 15:55:20.142964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:19 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:20.231384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b47a6443-8e0f-4141-bbbc-7c6bde88a2d9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.932042 Jul 14 15:55:20.240865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 8/16] 10.222.0.47 () {62 vars in 1199 bytes} [Thu Jul 14 15:55:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 943 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 15:55:20.314636 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f55f8e43-afba-4954-ac16-13d028857778 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:20.315353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f55f8e43-afba-4954-ac16-13d028857778 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:20.409642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942799234", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:20.458565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f55f8e43-afba-4954-ac16-13d028857778 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:20.474253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f55f8e43-afba-4954-ac16-13d028857778 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1214 microversion: 2.1 time: 0.163599 Jul 14 15:55:20.476323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 9/17] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:20 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:20.535423 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] validate_networks() for [('5a4b02bb-8411-4c20-b73b-d6921ecea2f8', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:20.807760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-170114437", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761c7f07-2b9f-4965-8183-b20363082c34"}], "security_groups": [{"name": "tempest-securitygroup--744336650"}], "key_name": "tempest-keypair-1530033389", "user_data": "}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:21.189383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] validate_networks() for [('761c7f07-2b9f-4965-8183-b20363082c34', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:21.471998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:21.472580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:21.472881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:21.473290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:21.473884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:21.495253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.497240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:21.499939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.500860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:21.557333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:21.570135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for user 81ca45714ee44a549fd002b4aa13973b and project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:21.612410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:21.618581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:21.811651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-62c85a3d-dbea-4551-a0bf-5337c0553f08 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.403179 Jul 14 15:55:21.813138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 9/18] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:21.835984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:21.837226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:21.871966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.875139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:21.878468 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.878926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.164689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:22.190850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2e6dd9aa-2c88-49ab-897e-53b0c069c5fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1240 microversion: 2.1 time: 0.376590 Jul 14 15:55:22.191891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 10/19] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:21 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1240 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:22.198907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:22.199718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:22.206837 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.207490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.208586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.209217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.292823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:22.311460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5c53d487-f95c-444c-a5d0-3ce621b32fff tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1266 microversion: 2.1 time: 0.118247 Jul 14 15:55:22.325725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 11/20] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:22 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:22.338521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-716dfc77-4397-4c0f-b2df-dcb32af65f80 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:22.340516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-716dfc77-4397-4c0f-b2df-dcb32af65f80 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:22.365008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:22.365559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:22.366803 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:22.367322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:22.367842 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:22.381428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.382783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.383800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.384606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.452382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:22.459263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:22.496943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:22.499383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:22.608945 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-716dfc77-4397-4c0f-b2df-dcb32af65f80 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:22.625612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-716dfc77-4397-4c0f-b2df-dcb32af65f80 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1222 microversion: 2.1 time: 0.298486 Jul 14 15:55:22.628647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 12/21] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:22 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:22.743516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1a3be775-0633-4fe4-a626-512cace29e40 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.937343 Jul 14 15:55:22.744449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 10/22] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:22.757270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-935f683a-bd23-4ce7-8d5d-2a23fd3c19e2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:22.758256 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-935f683a-bd23-4ce7-8d5d-2a23fd3c19e2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:22.935232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-935f683a-bd23-4ce7-8d5d-2a23fd3c19e2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:22.946031 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-935f683a-bd23-4ce7-8d5d-2a23fd3c19e2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1241 microversion: 2.1 time: 0.193074 Jul 14 15:55:22.946031 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 13/23] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:22 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1241 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:23.215672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:23.216326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:23.228095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.229538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.231065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.232820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.332287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:23.332911 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:23.342997 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.343451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.348778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.349173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.467139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:23.485621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-54b9b0dd-4855-4319-bc75-68f6a9daeaed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1232 microversion: 2.1 time: 0.276979 Jul 14 15:55:23.487096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:23 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1232 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:23.646154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:23.647012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:23.655229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.655959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.657139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:23.657727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:23.951809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:23.973030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-acb8d4a2-1da6-48cf-876e-2957cfd0ca65 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1226 microversion: 2.1 time: 0.331941 Jul 14 15:55:23.973598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 12/25] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:23 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:23.990480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2eb1186a-a563-453c-a228-aa5c8a3a2160 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:24.006199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2eb1186a-a563-453c-a228-aa5c8a3a2160 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:24.070504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:24.083124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8b04869e-a8d1-4682-b1f8-d3bfad2161eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1272 microversion: 2.1 time: 0.752390 Jul 14 15:55:24.083124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 14/26] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:23 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:24.228092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2eb1186a-a563-453c-a228-aa5c8a3a2160 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:24.235677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2eb1186a-a563-453c-a228-aa5c8a3a2160 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1241 microversion: 2.1 time: 0.257392 Jul 14 15:55:24.238922 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:23 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1241 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:24.511673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:24.511673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:24.524321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:24.524784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:24.537011 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:24.537587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:24.819479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:24.829861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-68f680c4-325c-4fc7-95d4-39de72f2e782 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1296 microversion: 2.1 time: 0.328863 Jul 14 15:55:24.840846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 15/28] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:24 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1296 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:24.991614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:24.992356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:25.017033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.017433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.018284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.018723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.099922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:25.101123 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:25.116962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.122050 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.127466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.137589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.294708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:25.308915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8455e229-5cbb-4162-baf7-d65ce53acca1 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1272 microversion: 2.1 time: 0.213591 Jul 14 15:55:25.319348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 16/29] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:25 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:25.347634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:25.348641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:25.396582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.397216 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.402047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.411338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.583605 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:25.595418 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8b245d51-18e9-4369-9f8b-11a75661de83 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1274 microversion: 2.1 time: 0.608307 Jul 14 15:55:25.603062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 14/30] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:24 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1274 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:25.849284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:25.849725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:25.856713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.862572 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:25.863825 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:25.874240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.134061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:26.158616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ce732e9d-8f97-43f7-9129-5090b4d431a3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1237 microversion: 2.1 time: 0.838014 Jul 14 15:55:26.160438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 17/31] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:25 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1237 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:26.231136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:26.262545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f89f9141-1879-4efc-903b-5a641a105d38 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1294 microversion: 2.1 time: 0.418046 Jul 14 15:55:26.269257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 15/32] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:25 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1294 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:26.326678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:26.327616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:26.345132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.345626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.356107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.356107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.628926 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:26.629801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:26.654875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.656232 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.659355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.666364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.817918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:26.830155 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bd0c6224-5344-4cf4-8894-565aa638f6a8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1292 microversion: 2.1 time: 0.212670 Jul 14 15:55:26.845907 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:26 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:27.177120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:27.177846 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:27.190071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.190578 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.195486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.196015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.752827 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:27.752827 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-54ef8cc2-80e1-47f8-8cfc-96ef6424ee41 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1301 microversion: 2.1 time: 0.571710 Jul 14 15:55:27.757339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 17/34] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:27 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1301 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:27.778360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:27.780457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:27.803478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.804960 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.806049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.806674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.951953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:27.972948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-98c329cd-e4c1-4887-83ef-1226d041d380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1294 microversion: 2.1 time: 0.213792 Jul 14 15:55:27.974168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 18/35] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:27 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:27.988723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:27.989611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:27.999492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.000736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.001767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.002385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.182567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:28.191015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a51534d2-d396-4999-9ac0-bc3652ad5aae tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 1.868121 Jul 14 15:55:28.196624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 18/36] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:26 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:28.217507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-38337737", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323899ca-9d2f-48f4-8d8a-7de26106abb9"}], "security_groups": [{"name": "tempest-securitygroup--1578835434"}], "key_name": "tempest-keypair-113778405", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:28.343060 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:28.354215 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ddbe10d2-0a94-4519-8430-97af8ea3ba10 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1280 microversion: 2.1 time: 0.378328 Jul 14 15:55:28.355170 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 19/37] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:27 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1280 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:28.763338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:28.764909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:28.773520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.775889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.781370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.782075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.990002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] validate_networks() for [('323899ca-9d2f-48f4-8d8a-7de26106abb9', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:29.315222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:29.328467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-39d47435-c736-4deb-b267-b4cdb091d5d6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1299 microversion: 2.1 time: 0.568948 Jul 14 15:55:29.339330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 20/38] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:28 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1299 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:29.349768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:29.350515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:29.361403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.361403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:29.361403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.361403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:29.668098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:29.701053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7b789246-7fa1-4381-b688-a16e8f2c90ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.368609 Jul 14 15:55:29.702158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 21/39] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:29 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:29.716119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:29.716834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:29.731353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.736936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:29.737988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.738595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.097958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:30.097958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e3904296-8bf8-4f9b-beb5-9cb31e9011f9 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.376451 Jul 14 15:55:30.097958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 22/40] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:29 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:30.097958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:30.098993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:30.115617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.116124 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.116928 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.117379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.159731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:30.309709 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:30.326499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-131f9744-835d-42ba-85b1-fd294c10ac1b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1280 microversion: 2.1 time: 0.243225 Jul 14 15:55:30.329065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 23/41] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:30 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1280 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:30.358309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:30.359352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:30.378423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.380914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.383450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.388302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.652015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:30.665770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-777de0dd-44d0-4dd0-9f76-e04e33eb50c2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1299 microversion: 2.1 time: 0.320251 Jul 14 15:55:30.679538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 24/42] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:30 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1299 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:30.719049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:30.719678 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:30.747817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.748271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:30.755855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:30.756592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:31.384044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:31.394018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4aebe567-71b1-4e8a-a38e-a90b772e4d8a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.679164 Jul 14 15:55:31.407374 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 25/43] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:30 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:31.415755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:31.416378 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:31.442504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:31.442957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:31.449147 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:31.450700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:31.522672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:31.730497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:31.731669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:31.732670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:31.733236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:31.735323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:31.748997 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=31 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:31.756061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:31.759696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:31.760651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:31.761112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:31.817136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:31.823299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for user 95c6d7130d6c4ae4b8460807e6820ef1 and project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:31.897585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:31.899847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:32.067036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-423ad8cd-469b-48e8-8401-0921dffc36cd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.868619 Jul 14 15:55:32.068109 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 19/44] 10.222.0.47 () {62 vars in 1187 bytes} [Thu Jul 14 15:55:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 15:55:32.074155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:32.075403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:32.083361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.084313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.089938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.089938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.367102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.400888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c9e6348e-4de6-4708-b747-9c876d6ed323 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.992240 Jul 14 15:55:32.407516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 26/45] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:31 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:32.429074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=6 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:32.590438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.612180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-3facc747-7251-4289-8e19-cfb211fa7193 req-005200c3-5bff-4fcf-8c32-5d9765437654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14712f2-30e1-4219-a304-3769e1912a99", "tag": "911c67db-7509-459b-89bb-c26fca3d2074"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:32.612445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-83a51fa8-5c54-4b42-b3e1-0c3a5cb6a1b5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.535449 Jul 14 15:55:32.614484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 20/46] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:32 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:32.622885 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:32.624164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:32.643190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-3facc747-7251-4289-8e19-cfb211fa7193 req-005200c3-5bff-4fcf-8c32-5d9765437654 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.645198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-3facc747-7251-4289-8e19-cfb211fa7193 req-005200c3-5bff-4fcf-8c32-5d9765437654 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.660297 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.660972 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.662622 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.664077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.697389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-3facc747-7251-4289-8e19-cfb211fa7193 req-005200c3-5bff-4fcf-8c32-5d9765437654 service nova] Creating event network-changed:911c67db-7509-459b-89bb-c26fca3d2074 for instance c14712f2-30e1-4219-a304-3769e1912a99 on hv-cinder-83716 Jul 14 15:55:32.697974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-3facc747-7251-4289-8e19-cfb211fa7193 req-005200c3-5bff-4fcf-8c32-5d9765437654 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:55:32.699292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.699741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.700594 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.701592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.710342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:32.712540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.compute.rpcapi [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:55:32.713831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] Releasing lock "compute-rpcapi-router" {{(pid=129992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:55:32.736607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a2e2c24c-7f87-4266-80a5-ff40081fdc89 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327286 Jul 14 15:55:32.737540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 27/47] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:32.753019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:32.754523 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:32.760244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:32.821128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.829603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.831153 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.832543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b0228bef-f2fe-4021-804f-90f10bd07dfe tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1279 microversion: 2.20 time: 0.093582 Jul 14 15:55:32.833094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 28/48] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:32 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:32.847925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:32.848932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:32.856308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.856924 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.857873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:32.858600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:32.874803 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:32.886271 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-88130e58-bb3f-49b8-9312-1f0fe5c4f9fa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.268045 Jul 14 15:55:32.886903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 21/49] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:32 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:33.054587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.068759 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-faab94a9-39cc-4880-af41-7db03bda9613 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.234471 Jul 14 15:55:33.078670 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 29/50] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:32 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:33.206160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-bb520741-ce00-4ef5-b2de-7d213b039f81 req-4a0ebcba-721e-4050-ba78-658657be47fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f715237-95a2-47e9-a4ed-f6eb17a3743d", "tag": "ffb11877-5d54-4737-ab2f-c1f373fd70c8"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:33.219162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-bb520741-ce00-4ef5-b2de-7d213b039f81 req-4a0ebcba-721e-4050-ba78-658657be47fe service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.219800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-bb520741-ce00-4ef5-b2de-7d213b039f81 req-4a0ebcba-721e-4050-ba78-658657be47fe service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.244434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-bb520741-ce00-4ef5-b2de-7d213b039f81 req-4a0ebcba-721e-4050-ba78-658657be47fe service nova] Creating event network-changed:ffb11877-5d54-4737-ab2f-c1f373fd70c8 for instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d on hv-cinder-83716 Jul 14 15:55:33.245299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-bb520741-ce00-4ef5-b2de-7d213b039f81 req-4a0ebcba-721e-4050-ba78-658657be47fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=129991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:55:33.246794 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.247450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.248678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.249212 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.271143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.compute.rpcapi [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:55:33.273173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] Releasing lock "compute-rpcapi-router" {{(pid=129991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:55:33.296577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ffbb3ce6-1516-4dba-b0df-ae91df6e3a44 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166831 Jul 14 15:55:33.298104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 22/51] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:33.421760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:33.422375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:33.431350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.431906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.432745 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.433251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.623005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:33.623704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:33.635806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.636689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.637676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.638502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.641526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.656343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1c287bf9-31f5-45bc-b5d5-0d100dcf6334 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.234865 Jul 14 15:55:33.657031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 30/52] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:33 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:33.817103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.826974 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0275c586-906f-4d91-bba5-79bcd37b3e77 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.208034 Jul 14 15:55:33.827874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 23/53] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:33 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:33.852460 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:33.853303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:33.860358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.860358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.860802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.861260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.904770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:33.905238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:33.922491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.923116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.924047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:33.924524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:33.941918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.954884 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.956399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:33.957523 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-297d77f3-ee54-4966-9abe-74987d238687 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1283 microversion: 2.20 time: 0.109251 Jul 14 15:55:33.958121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 31/54] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:33 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:34.088271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:34.089207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:34.095410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.096058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.096846 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.097278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.123830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:34.132588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1089a1cf-14ce-4df2-94ae-e9b73ac1540d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.233845 Jul 14 15:55:34.133174 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 24/55] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:33 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:34.299869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:34.308830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1237ae85-ca24-4875-baae-827600c397f5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.225186 Jul 14 15:55:34.319455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 32/56] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:34 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:34.683416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:34.684158 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:34.698855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.698855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.698855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.698855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.846066 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:34.869770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:34.869770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.869770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.869770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.871611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.871696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:34.871696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-39dc1d0c-9241-4706-a74c-afe190dcbc42 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.199817 Jul 14 15:55:34.872805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 25/57] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:34 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:34.979800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:34.980524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:34.987582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.988138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:34.988997 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:34.989514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.062648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.072487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c980d1c4-17d1-486a-8398-afec7d1097a9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.231532 Jul 14 15:55:35.073645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 33/58] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:34 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:35.102621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.114934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.117588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.119362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e572b8d9-9169-4af5-a03d-d3fa9a4793cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1283 microversion: 2.20 time: 0.144271 Jul 14 15:55:35.120539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 26/59] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:34 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:35.150353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:35.151130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:35.157727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.158296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.159315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.159948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.328834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:35.328834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:35.337851 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.340246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.342335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.342849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.344564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.350805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e0011c25-c23f-4a6c-854d-f9c40fcc1483 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.204875 Jul 14 15:55:35.361139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 34/60] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:35 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:35.495925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:35.504660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9c6a1e0c-6571-4b71-b4c3-b291ec305893 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.181621 Jul 14 15:55:35.505479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 27/61] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:35 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:35.890348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:35.891877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:35.903423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.903876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:35.904674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:35.905161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.090129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:36.091430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:36.095722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.098175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.098808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.100989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.101582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.104432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e8c22807-76fe-422d-98a1-ea0b2262aea2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.219098 Jul 14 15:55:36.105052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 35/62] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:35 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:36.138291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:36.139289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:36.145942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.146401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.161145 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.161740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.298947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.299120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.303569 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:36.310923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e4c05e80-3af9-406b-986d-4fef9e124dbc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.225117 Jul 14 15:55:36.311518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 28/63] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:36 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:36.320693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.320693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.320693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a06d21e5-b5ba-4d5b-a8f5-f93b03e6e9fa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1283 microversion: 2.20 time: 0.185474 Jul 14 15:55:36.324149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 36/64] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:36 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1283 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:36.368863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:36.369476 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:36.376340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.376788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.377559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.378086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.525485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.526409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:36.527247 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:36.533436 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d833cedd-d6eb-4112-afc8-be17d91901c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.169006 Jul 14 15:55:36.537858 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 29/65] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:36 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:36.540168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.540624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.541413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:36.541936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:36.697639 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:36.710363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e04b0a3e-92e7-4e4c-8d0b-713b0e8fdf26 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.187943 Jul 14 15:55:36.711147 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 37/66] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:36 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:37.121753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:37.122418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:37.129442 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.130229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.130720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.131161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.295493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.307406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0a55df47-6410-4190-af10-420188d48b2c tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.187809 Jul 14 15:55:37.307406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 30/67] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:37 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:37.331396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:37.333922 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:37.342559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:37.343418 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.343738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:37.343851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.344630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.345278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.351446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.352325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.353503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.354090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.426666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.436335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.437991 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.439199 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f0e23233-ba02-46c9-a03c-0f475d8be34a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1283 microversion: 2.20 time: 0.102411 Jul 14 15:55:37.443133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 31/68] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:37 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:37.533394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.541305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6aa0fafc-6c12-4d51-9401-ab0fc106296e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.216897 Jul 14 15:55:37.545860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 38/69] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:37 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:37.559708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:37.560424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:37.568003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.568552 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.570511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.570511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.734915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:37.734915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:37.735101 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.735485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.736637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:37.737226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:37.745479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.760209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bb28f190-260f-4a7e-a09b-e1438738226f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.204430 Jul 14 15:55:37.763420 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 32/70] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:37 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:37.902619 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:37.910125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-98798b89-8855-4c6b-86e1-b9ebbc82ab72 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.186849 Jul 14 15:55:37.910701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 39/71] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:37 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:38.323039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:38.324279 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:38.332594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.333294 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:38.334114 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.334585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:38.469777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:38.469777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:38.474251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.475001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:38.476669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.477461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:38.595006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:38.615556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:38.627173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:38.629024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b24dce84-7f5b-46d9-b6c2-00f17098a0fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1283 microversion: 2.20 time: 0.174192 Jul 14 15:55:38.630796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 40/72] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:38 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:38.659410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:38.665576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:38.681941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.682818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:38.684510 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:38.685157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.073069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.081625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cea4d5f1-eeb8-4a01-82fa-00c28e4f0ece tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.763165 Jul 14 15:55:39.082285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 33/73] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:38 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:39.089624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.091929 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:39.092731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:39.097981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-df2e6bf7-d481-4d74-9220-5cd3b6ffb943 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.453537 Jul 14 15:55:39.098577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 41/74] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:38 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:39.104759 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:39.105598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:39.112012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.112706 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.114742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.115368 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.118183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.122651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.122651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.122651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.377475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.390650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a94c87bc-dbf1-40a6-bc52-adbb11e45a7f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.290965 Jul 14 15:55:39.391466 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 42/75] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:39 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:39.520325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.528711 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-45d14944-cd57-4a8d-ac54-996491810132 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.445209 Jul 14 15:55:39.538797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 34/76] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:39 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:39.651383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:39.654755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:39.660436 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.661277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.662306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:39.663627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:39.759270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.768660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.770568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:39.773166 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e1ac33e6-d677-48e9-aa0b-a1ba1f0d7590 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1331 microversion: 2.20 time: 0.127399 Jul 14 15:55:39.774458 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 43/77] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:39 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:40.103825 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:40.103825 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:40.109391 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.109835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.116357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.116977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:40.117670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.117783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:40.125107 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.125107 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.125527 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.126162 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.306277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:40.318190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-70ad7c0e-c0cd-45db-b6c5-20033dde869c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.205490 Jul 14 15:55:40.329305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 44/78] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:40 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:40.408778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:40.418783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:40.429729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.431242 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.432031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.433026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.458595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:40.650048 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:40.661453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f7b2ec27-3c8d-4626-88e7-7404797bd8bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.256767 Jul 14 15:55:40.664091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 45/79] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:40 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:40.669284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:40.670219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:40.681604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.682388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.683190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.683887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.697758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:40.714915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-523a8614-b74f-41dd-8a2e-2b9e1ebf1c13 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.620126 Jul 14 15:55:40.726113 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 35/80] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:40 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:40.731654 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-80879732-b4d4-4f64-9347-ead0925c5c4f req-d1ae4ec0-0f24-40c8-9ace-a0100664f487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898f0bbf-f711-46da-a57f-3b09e9d9b926", "tag": "cf23c7f1-ddcd-4709-af66-04c74206d848"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:40.741280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-80879732-b4d4-4f64-9347-ead0925c5c4f req-d1ae4ec0-0f24-40c8-9ace-a0100664f487 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.742600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-80879732-b4d4-4f64-9347-ead0925c5c4f req-d1ae4ec0-0f24-40c8-9ace-a0100664f487 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.755168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-80879732-b4d4-4f64-9347-ead0925c5c4f req-d1ae4ec0-0f24-40c8-9ace-a0100664f487 service nova] Creating event network-changed:cf23c7f1-ddcd-4709-af66-04c74206d848 for instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 on hv-cinder-83716 Jul 14 15:55:40.768238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-80879732-b4d4-4f64-9347-ead0925c5c4f req-d1ae4ec0-0f24-40c8-9ace-a0100664f487 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034887 Jul 14 15:55:40.768238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 36/81] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:40.794856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:40.795769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:40.806933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.820630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:40.836217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:40.836217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.001718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.013250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.017364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.019786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-505a27da-aa33-4659-85c8-c11d44225ce2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1339 microversion: 2.20 time: 0.230550 Jul 14 15:55:41.022643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 37/82] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:40 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:41.039236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.050284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-224327db-9d54-4616-a7bd-8f7805ae0341 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.384766 Jul 14 15:55:41.050858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 46/83] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:40 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:41.343834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:41.343834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:41.357433 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.358247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.359225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.359845 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.683937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:41.685358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:41.695779 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.696316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.697828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.698365 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.886123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.893992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-013eefec-ab1c-48d4-a96e-1cb2cf7bbce4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.218258 Jul 14 15:55:41.894700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 47/84] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:41 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:41.899696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:41.901068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:41.907373 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.907913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.908780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:41.909293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:41.983247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:41.993429 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ab3fa751-5c59-46bf-81c4-9b35a934b24f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.660927 Jul 14 15:55:42.003868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 38/85] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:41 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:42.040780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:42.041272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:42.050088 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.050375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.050982 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.051689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.096070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:42.105344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9de17c19-919a-4d68-ad9b-cb216084326d tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.209465 Jul 14 15:55:42.106097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 48/86] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:41 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:42.121388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:42.122279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:42.125268 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:42.129713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.130506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.131977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.132569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.137483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:42.139122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:42.140735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b1e74ed5-62a1-475f-912a-cea4e54d3fa9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1337 microversion: 2.20 time: 0.104859 Jul 14 15:55:42.141403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 39/87] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:42 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:42.315447 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:42.323511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-031b93a1-f89a-4a46-a0d7-23e83939d08e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.206896 Jul 14 15:55:42.324122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 49/88] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:42 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:42.899301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868856cc-c674-43d8-bd8d-3e579171b462", "tag": "d4081dea-6bfc-40cc-a45c-ca2d8813c468"}, {"name": "network-changed", "server_uuid": "537ae16a-face-46a6-9841-8bde80b7a056", "tag": "362b8892-2aa5-426d-92be-a5ab32fd8d51"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:42.904194 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=5 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:42.913336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:42.914530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:42.923287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=28 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:42.925253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.929989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.932577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.934351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:42.941298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:42.941809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.005352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] Creating event network-changed:d4081dea-6bfc-40cc-a45c-ca2d8813c468 for instance 868856cc-c674-43d8-bd8d-3e579171b462 on hv-cinder-83716 Jul 14 15:55:43.006008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] Creating event network-changed:362b8892-2aa5-426d-92be-a5ab32fd8d51 for instance 537ae16a-face-46a6-9841-8bde80b7a056 on hv-cinder-83716 Jul 14 15:55:43.016984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-8d01d8db-b30c-4252-bcc3-a6864fb5b5f5 req-7a11091d-e461-408f-b7f8-40d6f818b18c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.124505 Jul 14 15:55:43.021927 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 40/89] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:43.034279 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:43.035012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:43.054465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.060642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.061480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.063570 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.270812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:43.353307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.361330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0a5addd8-199d-4187-b45b-e361451f5ead tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.452288 Jul 14 15:55:43.384475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 50/90] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:42 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:43.389465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:43.401480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:43.429077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:43.431388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.431801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.443586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.444732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.638161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.651804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-796d7487-622f-484f-84a5-99c76f2fee2f tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.266100 Jul 14 15:55:43.652651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 51/91] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:43 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:43.667912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:43.668811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:43.675307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.676065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.677346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.678040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.746498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.758874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-15c2850b-65af-4619-917e-2850cc47c46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.735584 Jul 14 15:55:43.759985 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 41/92] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:43 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:43.771633 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:43.772561 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:43.779146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.779932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.780902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:43.781547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:43.918931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.928234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.930668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:43.932817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-71c60dd4-06ea-46e5-8648-6beb2bcc2fec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1337 microversion: 2.20 time: 0.268757 Jul 14 15:55:43.946059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 52/93] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:43 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1337 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:44.185612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:44.198783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d46cbe12-fc38-40f7-9569-98f2987b120e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.437086 Jul 14 15:55:44.199582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 42/94] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:43 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:44.389938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:44.390754 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:44.398989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.399553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.400460 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.401089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.669419 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:44.670193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:44.679106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:44.679257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.679571 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.684836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.685602 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.688025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-51394ee5-ec0d-4fab-a575-a5c37c821ff3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.302048 Jul 14 15:55:44.689320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 53/95] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:44 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:44.777557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:44.778430 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:44.793643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.793643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.794983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.795700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.922546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:44.933396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-432496e5-7deb-4fca-ac62-11d5440b81ad tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.267567 Jul 14 15:55:44.939337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 43/96] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:44 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:44.958888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:44.958888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:44.970477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.972085 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:44.973086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:44.983863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.054998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.094266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-eb6b3425-269e-45c8-9901-295c3b2a7f7b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.300750 Jul 14 15:55:45.098863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 54/97] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:44 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:45.271809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.284606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.294393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.299333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-000cc5d6-7215-4350-ae0e-45ca6bc4266d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.350927 Jul 14 15:55:45.302179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 44/98] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:44 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:45.317292 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:45.320512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:45.335314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.337753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.339875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.341621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.448480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-7ffc3d97-f1a7-4b52-8a66-406fc96aba87 req-e3dc2b5b-86d8-49cf-aa33-3118e7f3acf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f715237-95a2-47e9-a4ed-f6eb17a3743d", "name": "network-vif-plugged", "status": "completed", "tag": "ffb11877-5d54-4737-ab2f-c1f373fd70c8"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:45.483863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7ffc3d97-f1a7-4b52-8a66-406fc96aba87 req-e3dc2b5b-86d8-49cf-aa33-3118e7f3acf6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.483863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7ffc3d97-f1a7-4b52-8a66-406fc96aba87 req-e3dc2b5b-86d8-49cf-aa33-3118e7f3acf6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.505796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-7ffc3d97-f1a7-4b52-8a66-406fc96aba87 req-e3dc2b5b-86d8-49cf-aa33-3118e7f3acf6 service nova] Creating event network-vif-plugged:ffb11877-5d54-4737-ab2f-c1f373fd70c8 for instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d on hv-cinder-83716 Jul 14 15:55:45.517770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-7ffc3d97-f1a7-4b52-8a66-406fc96aba87 req-e3dc2b5b-86d8-49cf-aa33-3118e7f3acf6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341769 Jul 14 15:55:45.520778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 55/99] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:45.717610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:45.718508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:45.727046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.727506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.728290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.729102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.833979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.842020 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d21ceb0e-bc16-4432-9c6e-0dfb6e02fc5c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.537217 Jul 14 15:55:45.842810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 45/100] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:45 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:45.865913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:45.873546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-58c56f82-b8d6-49a4-82ad-ea7bcb42e763 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.161669 Jul 14 15:55:45.874147 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 56/101] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:45 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:45.950822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:45.951464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:45.957928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.958377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:45.959148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:45.960224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.112017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:46.113315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:46.121203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.121661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.122494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.122929 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.190954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:46.191728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:46.199788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-86eaa9a1-0488-4f29-b553-257747119bcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.252785 Jul 14 15:55:46.203496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 46/102] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:45 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:46.285391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:46.294575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-406634b6-bcb8-4063-a792-952a0a1089d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.187091 Jul 14 15:55:46.295158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 57/103] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:46 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:46.318875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:46.320073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:46.329369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.329369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.329369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.329369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.449411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-2a9a7288-7640-4821-bf5d-4ab73f55ae9b req-91ca1e9b-216c-4578-a689-22aa3e4f28c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:46.463724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-2a9a7288-7640-4821-bf5d-4ab73f55ae9b req-91ca1e9b-216c-4578-a689-22aa3e4f28c7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.464665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-2a9a7288-7640-4821-bf5d-4ab73f55ae9b req-91ca1e9b-216c-4578-a689-22aa3e4f28c7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.481586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-2a9a7288-7640-4821-bf5d-4ab73f55ae9b req-91ca1e9b-216c-4578-a689-22aa3e4f28c7 service nova] Creating event network-changed:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:55:46.487431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-2a9a7288-7640-4821-bf5d-4ab73f55ae9b req-91ca1e9b-216c-4578-a689-22aa3e4f28c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043961 Jul 14 15:55:46.488081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 58/104] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:46.860372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:46.861183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:46.868171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.868840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.869706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.870269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.953733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:46.962497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:46.968606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:46.968606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-28a2033c-6f1d-4489-9ddb-f65b38db517a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.651878 Jul 14 15:55:46.968606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 47/105] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:46 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:46.971835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:46.972432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:46.979303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.979769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:46.981304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:46.981738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.050609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:47.075833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-06d2815c-e4fb-4b8d-b00c-d3a254d1517b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.219665 Jul 14 15:55:47.078313 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 59/106] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:46 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:47.217863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:47.218639 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:47.230712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.232369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.233433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.234000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.443896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:47.453735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:47.457970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2d38a164-e28a-4353-9f30-4e3026866d63 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.242860 Jul 14 15:55:47.460749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 60/107] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:47 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:47.468953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a96ef60d-df06-42d2-9d88-308531711532 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.500722 Jul 14 15:55:47.469762 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 48/108] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:46 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:47.484111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:47.485165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:47.492714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.493502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.499143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.499911 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.538210 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-389ffcc6-f19f-47ea-ae80-5d697eed2640 req-065936b0-7ad4-413c-853d-8869f95efbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14712f2-30e1-4219-a304-3769e1912a99", "name": "network-vif-plugged", "status": "completed", "tag": "911c67db-7509-459b-89bb-c26fca3d2074"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:47.563331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-389ffcc6-f19f-47ea-ae80-5d697eed2640 req-065936b0-7ad4-413c-853d-8869f95efbe8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.563823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-389ffcc6-f19f-47ea-ae80-5d697eed2640 req-065936b0-7ad4-413c-853d-8869f95efbe8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.606118 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-389ffcc6-f19f-47ea-ae80-5d697eed2640 req-065936b0-7ad4-413c-853d-8869f95efbe8 service nova] Creating event network-vif-plugged:911c67db-7509-459b-89bb-c26fca3d2074 for instance c14712f2-30e1-4219-a304-3769e1912a99 on hv-cinder-83716 Jul 14 15:55:47.612355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-389ffcc6-f19f-47ea-ae80-5d697eed2640 req-065936b0-7ad4-413c-853d-8869f95efbe8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078856 Jul 14 15:55:47.613928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 49/109] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:47.721998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:47.731699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-561e9878-e19f-449f-a115-6c00cfef4c66 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.269673 Jul 14 15:55:47.732288 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 61/110] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:47 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:47.985802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:47.986553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:47.993385 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.993847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:47.994609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:47.995049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.110076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:48.110695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:48.118317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.118781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.119559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.119992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.138737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.147630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.149219 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.151737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-08e6d70b-c6a4-4293-80bd-9f422ba74c54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.169023 Jul 14 15:55:48.151737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 50/111] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:47 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:48.255543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.265150 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f82708da-f700-413b-9c74-502bb1ade2ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.159090 Jul 14 15:55:48.265856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 62/112] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:48 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:48.477171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:48.477782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:48.484498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.485002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.485778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.486250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.487438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:48.488042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:48.495013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.495502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.496266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.496701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.515859 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:48.678059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.678059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b4ee473e-90a7-4a13-8742-8ea40c09a5ab tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.178670 Jul 14 15:55:48.678059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 51/113] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:48 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:48.679453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.689802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-18a616b4-d7c0-4d9c-b64f-d6797ba12a2f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.206074 Jul 14 15:55:48.690481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 63/114] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:48 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:48.748689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:48.749298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:48.755717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.756225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.757946 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:48.758543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:48.900135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:48.908878 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7d60514f-68dd-409f-a1b0-52bd9aa32b89 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.164214 Jul 14 15:55:48.909476 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 52/115] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:48 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:49.168891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:49.169532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:49.175714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.185027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.185027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.185027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.283647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:49.284267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:49.291099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.291553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.292321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.292753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.311520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.318325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.319845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.320992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bd4005f1-291e-4a03-b036-5b2deb419ab5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.156126 Jul 14 15:55:49.321555 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 64/116] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:49 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:49.421685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.429948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3fda1e35-96a3-42b2-a928-992ee59986c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.150774 Jul 14 15:55:49.430529 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 53/117] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:49 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:49.689987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:49.693490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:49.698730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.699187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.700235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.700833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.708192 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:49.708800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:49.715735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.716182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.716944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.717375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.849742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.855168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-73e6e85a-1ad2-4479-ada7-a94983848fcb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.168941 Jul 14 15:55:49.856036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 65/118] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:49 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:49.866704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:49.874652 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-93d63f5f-5ce6-4b79-bf01-6f079eeb9b45 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.170196 Jul 14 15:55:49.875201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 54/119] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:49 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:49.926700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:49.927306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:49.933538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.934022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:49.934784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:49.935220 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.064192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:50.072194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-39db5cc0-85c2-4cb9-b13a-fcc599af7dc8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.149687 Jul 14 15:55:50.073115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 66/120] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:49 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:50.339789 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:50.340310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:50.346221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.346668 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.347419 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.347843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.447582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:50.448876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:50.454948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.455390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.456663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.456663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.483745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:50.491046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:50.492606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:50.493765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f320e824-5e3b-44e8-8c7b-0328e7aa2e75 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.158008 Jul 14 15:55:50.494386 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 55/121] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:50 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:50.593429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:50.601046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3662dedb-672b-4b99-b64c-9b9f0e2502f0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.157860 Jul 14 15:55:50.601632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 67/122] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:50 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:50.873637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:50.874280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:50.882618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.883195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.884330 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.884780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.892732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:50.893343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:50.901923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.902371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:50.903156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:50.903588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.087285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.100331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-79f8a242-0a97-4ad0-9f19-5223554b535f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.211508 Jul 14 15:55:51.100997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 68/123] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:50 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:51.105804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:51.106673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:51.112633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.113084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.113880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.114320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.147278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.155027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-648d7e4a-d194-4cf5-b799-7ba0da074483 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.285832 Jul 14 15:55:51.158337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 56/124] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:50 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:51.262266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.272950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2707dcd0-6134-4050-80d5-0bd7eb2ac1db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.170000 Jul 14 15:55:51.273877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 69/125] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:51 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:51.512804 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:51.513490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:51.519768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.520198 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.520954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.521459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.617844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:51.618460 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:51.624522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.624975 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.625742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:51.626203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:51.656970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.679067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.690580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.690580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a318ff90-102c-42cd-b849-aa9556964082 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.173508 Jul 14 15:55:51.692573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 57/126] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:51 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:51.785964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:51.791497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-be7d3642-44b6-4e35-a438-a8598cd3ccd0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.178014 Jul 14 15:55:51.792071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 70/127] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:51 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:52.117502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:52.118359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:52.125008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.125456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.126260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.126841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.171673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:52.172274 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:52.183443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.183893 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.184653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.185256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.276040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.285417 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ffda385c-c75e-4cbf-a549-c187e48f2fd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.171040 Jul 14 15:55:52.286348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 58/128] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:52 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:52.290875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:52.291483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:52.298090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.298544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.299402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.299839 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.347487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.355025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a8caf78e-7e60-46c9-b2f3-76ace8f3fae5 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1314 microversion: 2.1 time: 0.187117 Jul 14 15:55:52.355599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 71/129] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:52 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:52.430032 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.437373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-be62c1ef-a902-4213-9e55-69754dbaa4b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.150249 Jul 14 15:55:52.438035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 59/130] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:52 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:52.700178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:52.701091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:52.707489 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.708083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.708865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.709300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.809393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:52.810264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:52.817053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.817495 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.818583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:52.818811 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:52.857004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.872580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.874135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.875256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fb31234c-530b-41a2-a6e4-6a357f79063e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.179389 Jul 14 15:55:52.875828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 72/131] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:52 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:52.969295 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:52.977806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bb58d314-71d0-4ae5-9e87-d999adb64d7b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.172495 Jul 14 15:55:52.978589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 60/132] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:52 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:53.058193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-af096342-0470-4d5b-99a7-844edf145704 req-1a05a8e7-3f4a-405e-8c4f-9211ca561601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868856cc-c674-43d8-bd8d-3e579171b462", "name": "network-vif-plugged", "status": "completed", "tag": "d4081dea-6bfc-40cc-a45c-ca2d8813c468"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:53.067722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-af096342-0470-4d5b-99a7-844edf145704 req-1a05a8e7-3f4a-405e-8c4f-9211ca561601 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.068169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-af096342-0470-4d5b-99a7-844edf145704 req-1a05a8e7-3f4a-405e-8c4f-9211ca561601 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.080468 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-af096342-0470-4d5b-99a7-844edf145704 req-1a05a8e7-3f4a-405e-8c4f-9211ca561601 service nova] Creating event network-vif-plugged:d4081dea-6bfc-40cc-a45c-ca2d8813c468 for instance 868856cc-c674-43d8-bd8d-3e579171b462 on hv-cinder-83716 Jul 14 15:55:53.086590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-af096342-0470-4d5b-99a7-844edf145704 req-1a05a8e7-3f4a-405e-8c4f-9211ca561601 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032265 Jul 14 15:55:53.087351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 73/133] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:53.303546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:53.304171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:53.310361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.310811 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.311578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.312015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.375485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:53.376194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:53.385015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.386001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.386781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.387260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.510081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:53.518242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2f4944ab-9a52-4a87-b3b9-1ca4f905215c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1362 microversion: 2.1 time: 0.219316 Jul 14 15:55:53.519575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 61/134] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:53 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:53.524324 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:53.525005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:53.527490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:53.532564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.533398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.534548 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.535140 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.555590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:53.564821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-eaba9014-8c31-45a1-abc6-afd8e668c292 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1501 microversion: 2.1 time: 0.195707 Jul 14 15:55:53.565499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 74/135] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:53 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:53.686968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:53.696977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0bde2d19-9c61-496f-a0a4-8fc2d50bcd3e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.176086 Jul 14 15:55:53.697557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 62/136] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:53 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:53.892938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:53.893545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:53.903095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.906799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.906799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:53.906799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:53.994882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:53.995504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:54.001937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.002610 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.003545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.003981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.041543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:54.049258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:54.050891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:54.052351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7b211bd8-eef0-4690-90e6-35bfc296b311 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.163306 Jul 14 15:55:54.053004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 75/137] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:53 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:54.146540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:54.154746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-54088ced-9cab-4a06-a0b2-7c3b82d927b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.163950 Jul 14 15:55:54.155348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 63/138] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:53 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:54.535730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:54.536548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:54.542836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.543285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.544140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.544736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.714572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:54.717642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:54.737900 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.738338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.739432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.739874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.745048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:54.773902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:54.800821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-26d8393c-0700-47cd-bb96-5cfe00a409ae tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1549 microversion: 2.1 time: 0.264302 Jul 14 15:55:54.813097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 76/139] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:54 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1549 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:54.828832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:54.829327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:54.838500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:54.839195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.840775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:54.842119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:54.842787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.002503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:55.013492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-10151f0c-c4c3-4abe-8f60-24405b763e2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.302874 Jul 14 15:55:55.014759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 64/140] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:54 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:55.045514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cfd0027d-81ab-4e60-8d5e-f184e25e6112 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220970 Jul 14 15:55:55.047127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 77/141] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 15:55:54 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:55:55.073493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:55.074645 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:55.082946 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.083916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.085085 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.085589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.112689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898f0bbf-f711-46da-a57f-3b09e9d9b926", "name": "network-vif-plugged", "status": "completed", "tag": "cf23c7f1-ddcd-4709-af66-04c74206d848"}, {"server_uuid": "537ae16a-face-46a6-9841-8bde80b7a056", "name": "network-vif-plugged", "status": "completed", "tag": "362b8892-2aa5-426d-92be-a5ab32fd8d51"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:55.123676 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.124298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.150608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] Creating event network-vif-plugged:cf23c7f1-ddcd-4709-af66-04c74206d848 for instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 on hv-cinder-83716 Jul 14 15:55:55.152539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] Creating event network-vif-plugged:362b8892-2aa5-426d-92be-a5ab32fd8d51 for instance 537ae16a-face-46a6-9841-8bde80b7a056 on hv-cinder-83716 Jul 14 15:55:55.172798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-120897f8-04d7-4f26-ba33-74d1f25c4922 req-410787d1-dd6a-4e1b-821f-b44390f50671 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060994 Jul 14 15:55:55.172798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 78/142] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:55:55.180998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:55.181699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:55.194209 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.197769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.198878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.199332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.311422 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:55.319458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:55.321026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:55.322183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cafdc961-1a5a-449e-9e9c-f8fd7df6b67d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.254868 Jul 14 15:55:55.332918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 65/143] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:55 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:55:55.515985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:55.526864 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c7e07c3c-98b9-4fd6-b52d-45b2751235fc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1366 microversion: 2.1 time: 0.350354 Jul 14 15:55:55.528843 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 79/144] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:55 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:55.802582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0935eb3-dbac-4a0f-b098-2fd1f5145191"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:55.805644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:55.813369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.814109 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:55.815053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:55.815696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.030324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:56.030930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:56.036958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.037440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.038239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.038676 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.448686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:56.472317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-87bf8d08-cf26-41da-aba9-ea5c8b0f15c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.445603 Jul 14 15:55:56.474602 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 80/145] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:56 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:56.482576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:56.483435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:56.490160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.491183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.491954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.492389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.754584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:56.759829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:56.765134 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:56.767264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:56.768639 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a54b85d6-db32-4f00-ace3-1d884b813080 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.292813 Jul 14 15:55:56.769356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 81/146] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:56 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:56.775300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:56.776329 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:56.785204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.786129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:56.786981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:56.788182 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.024807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.046451 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b85c6444-ae5e-454c-9cb2-f920ae56bdfc tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1556 microversion: 2.1 time: 0.271941 Jul 14 15:55:57.060446 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 82/147] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:56 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:57.065858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-a89fd520-31e9-43ad-a945-13733474efb2 req-7d5b40c9-0900-4c9b-9f1b-c6e6efe75b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14712f2-30e1-4219-a304-3769e1912a99", "tag": "911c67db-7509-459b-89bb-c26fca3d2074"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:57.083256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a89fd520-31e9-43ad-a945-13733474efb2 req-7d5b40c9-0900-4c9b-9f1b-c6e6efe75b2e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.084020 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a89fd520-31e9-43ad-a945-13733474efb2 req-7d5b40c9-0900-4c9b-9f1b-c6e6efe75b2e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.097004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-a89fd520-31e9-43ad-a945-13733474efb2 req-7d5b40c9-0900-4c9b-9f1b-c6e6efe75b2e service nova] Creating event network-changed:911c67db-7509-459b-89bb-c26fca3d2074 for instance c14712f2-30e1-4219-a304-3769e1912a99 on hv-cinder-83716 Jul 14 15:55:57.104819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-a89fd520-31e9-43ad-a945-13733474efb2 req-7d5b40c9-0900-4c9b-9f1b-c6e6efe75b2e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054763 Jul 14 15:55:57.105959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 83/148] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:57.112880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:57.113745 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:57.120901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.121720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.122947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.123485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.204949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-97cf108e-4d92-4ee6-845e-1b6b8f6af395 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097251 Jul 14 15:55:57.205495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 84/149] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 15:55:57 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:57.210753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-c5372efb-54bc-4d1d-9685-0a52f22f814e req-4dffb50f-bb55-4c9f-a79f-b7601010a175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "name": "network-vif-plugged", "status": "completed", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:57.220361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c5372efb-54bc-4d1d-9685-0a52f22f814e req-4dffb50f-bb55-4c9f-a79f-b7601010a175 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.220810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c5372efb-54bc-4d1d-9685-0a52f22f814e req-4dffb50f-bb55-4c9f-a79f-b7601010a175 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.234070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-c5372efb-54bc-4d1d-9685-0a52f22f814e req-4dffb50f-bb55-4c9f-a79f-b7601010a175 service nova] Creating event network-vif-plugged:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:55:57.241324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-c5372efb-54bc-4d1d-9685-0a52f22f814e req-4dffb50f-bb55-4c9f-a79f-b7601010a175 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Jul 14 15:55:57.242032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 85/150] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:57.492037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:57.492646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:57.499892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.501604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.502776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.505012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.766966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.778496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0e0bb626-f62c-49fb-a3af-98b1c8f0b565 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.291231 Jul 14 15:55:57.785113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 86/151] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:57 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:57.793600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:57.795697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:57.802501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.803127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.804050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.804574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.853388 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-54bc21df-aa1e-49cd-bcae-cf97212f2458 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "POST /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.054917 Jul 14 15:55:57.854102 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 66/152] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:55:55 2022] POST /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d/os-volume_attachments => generated 194 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:57.952833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.961396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.962915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.964023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5fee25ee-e800-4e9d-b3e7-3efaba1fe678 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.177624 Jul 14 15:55:57.964598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 87/153] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:57 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:55:58.803784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:58.804536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:58.825869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:58.826716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:58.827685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:58.828135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:58.984183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:58.986216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:58.992620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:58.997353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:58.997353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:58.997353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:59.004691 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:59.012567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a4d224ba-b621-4092-941c-eb0437a637ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.214251 Jul 14 15:55:59.013152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 67/154] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:58 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:59.127626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-31866caf-9fdd-4e58-ab85-15689c2b96ca req-b5c15c02-6c25-4c1d-ab8f-4efee55fdbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868856cc-c674-43d8-bd8d-3e579171b462", "tag": "d4081dea-6bfc-40cc-a45c-ca2d8813c468"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:59.141225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-31866caf-9fdd-4e58-ab85-15689c2b96ca req-b5c15c02-6c25-4c1d-ab8f-4efee55fdbb8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:59.142033 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-31866caf-9fdd-4e58-ab85-15689c2b96ca req-b5c15c02-6c25-4c1d-ab8f-4efee55fdbb8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:59.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-31866caf-9fdd-4e58-ab85-15689c2b96ca req-b5c15c02-6c25-4c1d-ab8f-4efee55fdbb8 service nova] Creating event network-changed:d4081dea-6bfc-40cc-a45c-ca2d8813c468 for instance 868856cc-c674-43d8-bd8d-3e579171b462 on hv-cinder-83716 Jul 14 15:55:59.172797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-31866caf-9fdd-4e58-ab85-15689c2b96ca req-b5c15c02-6c25-4c1d-ab8f-4efee55fdbb8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Jul 14 15:55:59.176016 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 68/155] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:55:59.197239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:59.207006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:59.208632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:59.210380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ad20b97d-529f-4302-bb69-77237ada4cbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.232108 Jul 14 15:55:59.210992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 88/156] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:55:58 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:56:00.029775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:00.030681 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:00.038196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.038670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.039460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.039936 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.191528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:00.200145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1b778cbd-eb13-49dc-9ee6-9dc8cf943287 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.175001 Jul 14 15:56:00.201486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 69/157] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:00 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:00.232695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:00.235129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:00.241578 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.242376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.243151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.244199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.393908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:00.403034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:00.404736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:00.405906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce317ecb-f9c7-4351-a494-be5a11bafc8f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.178623 Jul 14 15:56:00.406546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 89/158] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:00 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:56:01.218518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:01.219133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:01.226242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.226693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.227450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.227888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.380802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:01.389372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d4becf86-bfdc-45b0-a464-61728811899a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1322 microversion: 2.1 time: 0.174640 Jul 14 15:56:01.389897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 70/159] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:01 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:01.425534 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:01.426589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:01.434333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.435891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.437384 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.438199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.575484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:01.583457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:01.585499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:01.586647 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c227504d-9493-4596-997a-e425e165ac16 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.166177 Jul 14 15:56:01.587302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 90/160] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:01 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:56:02.406471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:02.407106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:02.414177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.414618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.415467 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.415896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.550786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:02.558984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d0f07049-e53e-4ce8-8e91-a5acf25402ed tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1516 microversion: 2.1 time: 0.156381 Jul 14 15:56:02.559625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 71/161] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:02 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:02.575815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:02.576815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:02.582853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.583312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.584090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.584541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.605201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:02.607156 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:02.609739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'flavor' on Instance uuid 537ae16a-face-46a6-9841-8bde80b7a056 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:56:02.613248 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.613704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.614510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.614951 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.791475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:02.799889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:02.801681 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:02.803535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a659e154-50aa-42cb-aa76-01ca9a4ea17e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.201999 Jul 14 15:56:02.805567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 72/162] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:02 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:56:03.080034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c4d677b7-c559-42ac-b764-561b12cd8e44 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056/action" status: 200 len: 32 microversion: 2.1 time: 0.508109 Jul 14 15:56:03.080677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 91/163] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:56:02 2022] POST /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:56:03.090187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.090936 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.097143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.097639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.098433 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.098866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.440550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:03.451987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-115b7e48-e1a3-41fe-8876-0686759684db tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.365772 Jul 14 15:56:03.452600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 73/164] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:03.824609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.827431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.834835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.838385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.840543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.841049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:04.010189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:04.019808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:04.022378 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:04.023284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ac8cffb8-e89f-4f2d-9980-f9a773062ccf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.204727 Jul 14 15:56:04.023848 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 92/165] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:56:04.469140 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:04.469884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:04.476863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:04.477384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:04.479537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:04.479537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:04.775204 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:04.783325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d1e8b542-c403-42bc-9355-ec4e49103bde tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.318594 Jul 14 15:56:04.784005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 74/166] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:04 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:05.056167 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:05.057236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:05.064370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.065106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:05.065915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.066509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:05.214087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:05.222709 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:05.224429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:05.225582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ea0217cb-2253-42b4-ac53-fcc3beb13616 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1405 microversion: 2.20 time: 0.178164 Jul 14 15:56:05.226229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 93/167] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:05 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:56:05.800932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:05.801835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:05.808355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.808805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:05.809572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.810081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.244684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:06.245367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:06.251490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.251945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.252712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.253146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.323009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:06.331267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-da10413c-b112-4c38-a87f-ea5e6b650509 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.534248 Jul 14 15:56:06.331950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 75/168] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:05 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:06.427917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:06.436613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:06.438318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:06.439515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-09b4184e-aeb7-4e6c-8a7d-b8610070e5bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1596 microversion: 2.20 time: 0.199009 Jul 14 15:56:06.440076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 94/169] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:56:06 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1596 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:56:06.458975 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:06.459782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:06.468267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.469076 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.470358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.470940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.615058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fa958039-507a-45d9-bcce-06e47e4dd801 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160137 Jul 14 15:56:06.616350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 76/170] 10.222.0.47 () {60 vars in 1315 bytes} [Thu Jul 14 15:56:06 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:56:07.350642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:07.351253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:07.358775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:07.359052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:07.359819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:07.360428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:07.503089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:07.512642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-61edd50e-4978-4ab1-8ab1-fe4a47d4c6b8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.166518 Jul 14 15:56:07.513557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 95/171] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:07 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:08.088113 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-38338b39-76e9-4868-9bef-ddd12e35ecc2 req-aec3eddc-edeb-4f6c-a365-b298f1db88f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:08.096268 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-38338b39-76e9-4868-9bef-ddd12e35ecc2 req-aec3eddc-edeb-4f6c-a365-b298f1db88f7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:08.096877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-38338b39-76e9-4868-9bef-ddd12e35ecc2 req-aec3eddc-edeb-4f6c-a365-b298f1db88f7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:08.118121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-38338b39-76e9-4868-9bef-ddd12e35ecc2 req-aec3eddc-edeb-4f6c-a365-b298f1db88f7 service nova] Creating event network-changed:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:56:08.125877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-38338b39-76e9-4868-9bef-ddd12e35ecc2 req-aec3eddc-edeb-4f6c-a365-b298f1db88f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041956 Jul 14 15:56:08.126609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 77/172] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:08.530062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:08.530669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:08.536694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:08.537660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:08.538452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:08.538889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:08.696216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:08.704362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-30a71267-30b2-40be-8524-359f704ec647 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.178253 Jul 14 15:56:08.705154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 96/173] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:08 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:09.721293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:09.722030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:09.729249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:09.729700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:09.730753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:09.731202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:10.031591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:10.039866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-af57bcad-419c-473f-bd81-b0605539ad99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.322695 Jul 14 15:56:10.040545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 78/174] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:09 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:11.057168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:11.057778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:11.063871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:11.064327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:11.065092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:11.065532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:11.194318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:11.202715 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5be54a95-6163-4a7b-800c-1f0aa913dcb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.149891 Jul 14 15:56:11.203284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 97/175] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:11 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:12.220224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:12.220764 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:12.227169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:12.227705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:12.228467 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:12.228897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:12.375962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:12.385197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-111388e3-d0f7-442f-a3f2-ba8619f2da20 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.168829 Jul 14 15:56:12.386000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 79/176] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:12 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:13.402454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:13.403066 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:13.409681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:13.410159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:13.410988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:13.411422 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:13.415861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:13.559234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:13.566925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-df029b03-69fc-47fd-8716-92af8a5351b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.168345 Jul 14 15:56:13.567409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 98/177] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:13 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:14.008568 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:14.009058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:14.015499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.015942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.016695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.017117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.046705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:56:14.063593 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:14.389311 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-941eaac3-5965-4d5c-ac7e-e3da51a8c909 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 204 len: 0 microversion: 2.1 time: 0.384248 Jul 14 15:56:14.389926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 80/178] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:56:14 2022] DELETE /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:56:14.398586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:14.399196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:14.405800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.406365 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.407026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.407463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.538237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:14.546246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e8c02595-1fab-49e1-8924-d2cc7a6b15eb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1553 microversion: 2.1 time: 0.152025 Jul 14 15:56:14.546814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 99/179] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:14 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:14.586209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:14.586977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:14.593650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.594143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.594935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.595373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.725223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:14.732994 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3f37b852-d014-4420-9eb5-5612dd15d531 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.152235 Jul 14 15:56:14.733713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 81/180] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:14 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:15.563560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:15.564468 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:15.570750 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.571204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.571965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.572403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.707509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:15.717202 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e946f2df-739f-407d-bead-61952bd30ccc tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1553 microversion: 2.1 time: 0.157519 Jul 14 15:56:15.717949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 100/181] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:15 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:15.751017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:15.751758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:15.758965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.759415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.760180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.760653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.889062 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:15.896641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e674d991-70ce-437f-9697-391d665797bb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.149357 Jul 14 15:56:15.897802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 82/182] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:15 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:16.739536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:16.740206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:16.746247 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:16.746701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:16.747470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:16.747905 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:16.885298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:16.903515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fd4d708e-3ee2-413e-918d-d33c93a3c009 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1553 microversion: 2.1 time: 0.167804 Jul 14 15:56:16.904105 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 101/183] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:16 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:16.918149 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:16.919017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:16.925782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:16.926535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:16.927314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:16.927804 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:17.065129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:17.073894 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b93d0a35-030b-453b-9e63-c076cd28e6b3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.159643 Jul 14 15:56:17.074482 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 83/184] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:16 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:17.921393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:17.922179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:17.930034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:17.930755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:17.931449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:17.931888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.080915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.090857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:18.091466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:18.100259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-47361c1b-9613-4119-a658-96aa37a0b9d2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1553 microversion: 2.1 time: 0.182990 Jul 14 15:56:18.100850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 102/185] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:17 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:18.103512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.104147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.104929 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.105367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.255278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.263162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1e8aa304-f5b9-4797-aec1-dc5df0d6ec03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.176096 Jul 14 15:56:18.263741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 84/186] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:18 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:18.397157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-9a55b242-f752-4abe-932d-ba1f1d43fd46 req-4c8d386a-c42e-4ec4-9adb-b9ca416465b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f715237-95a2-47e9-a4ed-f6eb17a3743d", "name": "network-vif-deleted", "tag": "ffb11877-5d54-4737-ab2f-c1f373fd70c8"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:18.407579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-9a55b242-f752-4abe-932d-ba1f1d43fd46 req-4c8d386a-c42e-4ec4-9adb-b9ca416465b6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.408019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-9a55b242-f752-4abe-932d-ba1f1d43fd46 req-4c8d386a-c42e-4ec4-9adb-b9ca416465b6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.421950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-9a55b242-f752-4abe-932d-ba1f1d43fd46 req-4c8d386a-c42e-4ec4-9adb-b9ca416465b6 service nova] Creating event network-vif-deleted:ffb11877-5d54-4737-ab2f-c1f373fd70c8 for instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d on hv-cinder-83716 Jul 14 15:56:18.429285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-9a55b242-f752-4abe-932d-ba1f1d43fd46 req-4c8d386a-c42e-4ec4-9adb-b9ca416465b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035717 Jul 14 15:56:18.430016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 103/187] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:19.117104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:19.117882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:19.124500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:19.124876 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:19.125650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:19.126129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:19.188638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:19.197103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6e27ed72-078a-4bb0-823d-26900f46381e tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1345 microversion: 2.1 time: 0.083922 Jul 14 15:56:19.197675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 85/188] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:19 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:19.281103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:19.281806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:19.288597 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:19.289044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:19.295144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:19.295144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:19.426793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:19.434522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3c0283cb-27c3-4e04-878a-78c98b33a542 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.157805 Jul 14 15:56:19.435377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 104/189] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:19 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:20.215764 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:20.216506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:20.223491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.223942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.225359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.225797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.258043 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.258493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.258960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lazy-loading 'fault' on Instance uuid 1f715237-95a2-47e9-a4ed-f6eb17a3743d {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:56:20.319254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd476a2bec8164b8bbf9a5aaa419a0351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dcc59c5829442da0518976525fe40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:20.327561 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ce126405-a6be-4a72-bb4e-ce4f5fc7c5f2 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 200 len: 1350 microversion: 2.1 time: 0.115636 Jul 14 15:56:20.328230 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 86/190] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:20 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:20.451481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:20.452093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:20.458127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.458602 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.459926 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.460359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.591104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:20.599269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ec083bca-dd72-4ce0-89ab-5eac11ddd17e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.151679 Jul 14 15:56:20.599844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 105/191] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:20 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:21.348332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:21.348957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:21.356094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.356559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.357338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.357781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.372080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] HTTP exception thrown: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Request method failure captured: Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d HTTP/1.1 Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxgqBKu415bYAgbqj6x5DyaVOXKZXIM1k1xSAH3er_Q5QZCOC8ywA0voDFU9j3Z7sArfztfOBSSR1yEoAtMyJGBEybH9gZ74Lj-eBvIevDRxp3howFKWC2ymHnx25ItYAG5EpQB3ZFlM6jygu658nO28RDK9vjvfzevujz35GHT54Q Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 15:56:21.377090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73dcc59c5829442da0518976525fe40b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73dcc59c5829442da0518976525fe40b"}]}] Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: d476a2bec8164b8bbf9a5aaa419a0351 Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.378807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '1f715237-95a2-47e9-a4ed-f6eb17a3743d'} Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:21.379955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.381265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.382905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Returning 404 to user: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:21.382905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3c1464aa-1ca1-4894-88e2-da09f358816a tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 404 len: 111 microversion: 2.1 time: 0.034221 Jul 14 15:56:21.382905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 87/192] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:21 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:21.489997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:21.491591 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:21.497996 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.498464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.499221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.499660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.512467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] HTTP exception thrown: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Request method failure captured: Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d/os-volume_attachments HTTP/1.1 Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxgqBKu415bYAgbqj6x5DyaVOXKZXIM1k1xSAH3er_Q5QZCOC8ywA0voDFU9j3Z7sArfztfOBSSR1yEoAtMyJGBEybH9gZ74Lj-eBvIevDRxp3howFKWC2ymHnx25ItYAG5EpQB3ZFlM6jygu658nO28RDK9vjvfzevujz35GHT54Q Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:56:21.523584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73dcc59c5829442da0518976525fe40b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73dcc59c5829442da0518976525fe40b"}]}] Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: d476a2bec8164b8bbf9a5aaa419a0351 Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.525122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'server_id': '1f715237-95a2-47e9-a4ed-f6eb17a3743d'} Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:21.526642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:21.527936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:21.529257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Returning 404 to user: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:21.529257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-66f01214-f253-4baa-8c06-1c23e6b0e8fb tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039231 Jul 14 15:56:21.529257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 106/193] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 15:56:21 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:21.616886 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:21.617520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:21.624500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.624959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.625734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:21.626206 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:21.760328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:21.771924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fcb6d73e-e0fe-4639-8590-7ec9717fa2b4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.159379 Jul 14 15:56:21.772748 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 88/194] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:21 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:22.790434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:22.791319 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:22.798412 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.799085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.800212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.800823 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.885590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:22.886196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:22.892508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.892968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.893913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.894359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.947364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:22.955286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5d770369-528a-4d1a-80d2-62859711ccff tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.169995 Jul 14 15:56:22.955870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 107/195] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:22 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:22.956009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] HTTP exception thrown: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Request method failure captured: Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d HTTP/1.1 Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxgqBKu415bYAgbqj6x5DyaVOXKZXIM1k1xSAH3er_Q5QZCOC8ywA0voDFU9j3Z7sArfztfOBSSR1yEoAtMyJGBEybH9gZ74Lj-eBvIevDRxp3howFKWC2ymHnx25ItYAG5EpQB3ZFlM6jygu658nO28RDK9vjvfzevujz35GHT54Q Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 15:56:22.957528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73dcc59c5829442da0518976525fe40b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73dcc59c5829442da0518976525fe40b"}]}] Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: d476a2bec8164b8bbf9a5aaa419a0351 Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.959575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '1f715237-95a2-47e9-a4ed-f6eb17a3743d'} Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:22.960490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.961615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.962793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Returning 404 to user: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:22.962793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-22c3c26d-6bde-4f9c-933e-19bdf8721181 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 404 len: 111 microversion: 2.1 time: 0.078706 Jul 14 15:56:22.962793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 89/196] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:56:22 2022] DELETE /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:56:22.967661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:22.968276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] [instance: 1f715237-95a2-47e9-a4ed-f6eb17a3743d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:22.974330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.974811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.975574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:22.976012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:22.989226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] HTTP exception thrown: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Request method failure captured: Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d HTTP/1.1 Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxgqBKu415bYAgbqj6x5DyaVOXKZXIM1k1xSAH3er_Q5QZCOC8ywA0voDFU9j3Z7sArfztfOBSSR1yEoAtMyJGBEybH9gZ74Lj-eBvIevDRxp3howFKWC2ymHnx25ItYAG5EpQB3ZFlM6jygu658nO28RDK9vjvfzevujz35GHT54Q Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:56:22.992111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73dcc59c5829442da0518976525fe40b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73dcc59c5829442da0518976525fe40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73dcc59c5829442da0518976525fe40b"}]}] Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 73dcc59c5829442da0518976525fe40b Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-DeleteServersTestJSON-1754489044 Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: d476a2bec8164b8bbf9a5aaa419a0351 Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-DeleteServersTestJSON-1754489044-project Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.993554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '1f715237-95a2-47e9-a4ed-f6eb17a3743d'} Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:22.994397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. Jul 14 15:56:22.995739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:56:22.996869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] Returning 404 to user: Instance 1f715237-95a2-47e9-a4ed-f6eb17a3743d could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:22.996869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-56bb2b9b-0715-46b0-877f-c4581934c081 tempest-DeleteServersTestJSON-1754489044 tempest-DeleteServersTestJSON-1754489044-project] 10.222.0.47 "GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d" status: 404 len: 111 microversion: 2.1 time: 0.029495 Jul 14 15:56:22.996869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 108/197] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:22 2022] GET /compute/v2.1/servers/1f715237-95a2-47e9-a4ed-f6eb17a3743d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:23.973440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:23.975273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:23.982208 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:23.982684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:23.983446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:23.983893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:24.206032 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:24.215129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f822f51a-7623-4ace-a518-8f8a869a5aec tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.246337 Jul 14 15:56:24.215709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 90/198] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:23 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:25.232723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:25.233329 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:25.239700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:25.240643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:25.241396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:25.241854 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:25.487490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:25.496841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d1f7c694-870a-4f55-8296-eb8d6bb358dd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.268175 Jul 14 15:56:25.497535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 109/199] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:25 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:26.522978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:26.523602 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:26.526563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:26.537677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:26.546750 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:26.547960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:26.548620 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:26.835328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:26.855682 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d76cabc4-10ec-455a-9638-5d17ffcd36fc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.339790 Jul 14 15:56:26.856582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 91/200] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:26 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:27.873255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:27.873960 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:27.876019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=65 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:27.881628 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:27.882187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:27.882956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:27.883568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:28.056007 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:28.067781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ecfc43fd-356e-43d8-a999-fd0f793e0898 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.198946 Jul 14 15:56:28.077065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 110/201] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:27 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:29.085300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:29.086013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:29.092800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:29.093267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:29.094045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:29.094490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:29.245489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:29.252899 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-52a62896-fc3a-45ff-80db-511f01bdcc4b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.172047 Jul 14 15:56:29.253463 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 92/202] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:29 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:30.271806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:30.273000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:30.279646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.280373 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.281222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.281724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.411568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:30.420044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fcffa8c4-ee7d-418d-8316-df05291d44e7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.153117 Jul 14 15:56:30.427766 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 111/203] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:30 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:31.436854 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:31.437492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:31.444358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:31.444837 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:31.445637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:31.446098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:31.584320 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:31.592063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f82aa65f-ecd9-4e42-880e-b9b69cd6f83e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.159002 Jul 14 15:56:31.592724 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 93/204] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:31 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:32.608728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:32.609527 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:32.615556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:32.616179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:32.617123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:32.617715 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:32.752127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:32.760110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a4d8cdf0-2be4-4d62-8941-0295fce91e92 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.155298 Jul 14 15:56:32.760689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 112/205] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:32 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:33.777005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:33.777612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:33.784258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.800473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:33.800473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.800473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:33.916326 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:33.923785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f71285cc-e5d6-437f-873a-1fb9d850c5f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.150841 Jul 14 15:56:33.924369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 94/206] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:33 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:34.940888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:34.941495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:34.949233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:34.949743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:34.950709 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:34.951170 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.086079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:35.094826 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b2d2e046-158d-4741-a622-3a28418fbd52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.157745 Jul 14 15:56:35.095402 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 113/207] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:34 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:36.112394 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:36.113002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:36.126427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.126427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.126427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.126427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.248531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:36.256599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7ede7ad0-ccf4-4792-b2fd-fbc86ca26488 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.148241 Jul 14 15:56:36.257171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 95/208] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:36 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:37.272932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:37.273539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:37.279540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.279992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.280755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.281198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.409736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:37.417964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cc14da6e-49aa-4de4-9a52-850989c894fe tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.149373 Jul 14 15:56:37.418541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 114/209] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:37 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:38.434870 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:38.435483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:38.442332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:38.443265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:38.444131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:38.444572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:38.575005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:38.582892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6c50a281-0ddf-4eeb-9370-ec09f7d1ee5d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.151947 Jul 14 15:56:38.583507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 96/210] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:38 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:39.600702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:39.601246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:39.607700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.608156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.608926 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:39.609368 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:39.759706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:39.767796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c0960535-4469-4c89-9079-6d277562827b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.171088 Jul 14 15:56:39.768391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 115/211] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:39 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:40.784404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:40.785075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:40.791498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:40.791952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:40.792710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:40.793151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:40.797180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:40.920227 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:40.927916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c63d95f9-6298-4523-8f34-03ace8f5766d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.147349 Jul 14 15:56:40.928432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 97/212] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:40 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:41.944940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:41.945539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:41.951519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:41.951966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:41.952710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:41.953141 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:42.082795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:42.086171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:42.090554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f2519dc3-2f4c-42fd-ac24-544bc644a690 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.150090 Jul 14 15:56:42.091152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 116/213] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:41 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:43.107468 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:43.108087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:43.114599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.115052 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.115891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:43.116331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:43.248369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:43.256662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e79db240-3822-4804-86a7-718f9b68af79 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.153922 Jul 14 15:56:43.257283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 98/214] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:43 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:44.274396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:44.275008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:44.281097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.281549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.282342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:44.282784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:44.411106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:44.419500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-65b62fc9-d1b3-46ad-b230-174555d77092 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.149844 Jul 14 15:56:44.420218 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 117/215] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:44 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:45.437599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:45.438434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:45.445500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.446048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.446769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:45.447209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:45.810713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:45.819349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-779f65a5-295f-4364-8e29-ed7ce630413e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.386654 Jul 14 15:56:45.829494 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 99/216] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:45 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:46.836313 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:46.836931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:46.843050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.843549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.844348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:46.844788 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:46.985156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:46.993391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-642fb302-4c38-4403-b8a0-90d7bc402069 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.161864 Jul 14 15:56:46.993990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 118/217] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:46 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:48.011068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:48.011684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:48.018263 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.018763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.019528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:48.019967 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:48.154146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:48.162053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-79cd4522-7d27-4c8e-b4f7-6120d24fb345 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.154293 Jul 14 15:56:48.162707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 100/218] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:48 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:49.179738 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:49.180353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:49.186696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.187098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.187876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:49.188317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:49.324668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:49.332293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0477ec92-7add-4d2e-b602-c9fa3f58f06c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.157262 Jul 14 15:56:49.332944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 119/219] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:49 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:50.351266 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:50.352526 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:50.361440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.361440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.361928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:50.362366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:50.501164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:50.502406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f3cee472-b42b-4163-9e93-15d0033a64a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.156621 Jul 14 15:56:50.503173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 101/220] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:50 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:51.519590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:51.520216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:51.526925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.535965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.535965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:51.535965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:51.679724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:51.687283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-28a35ed5-1135-4cc5-802c-a9acbf50304e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.171996 Jul 14 15:56:51.687853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 120/221] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:51 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:52.708543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:52.709761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:52.717132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.717647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.718450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:52.718888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:52.851189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:52.860201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-21a4ca4e-3a45-4ade-87c2-8c709eb2781a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1522 microversion: 2.1 time: 0.159407 Jul 14 15:56:52.861071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 102/222] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:52 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:53.877505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:53.878142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:53.884115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.884642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:53.885429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:53.886072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.017159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:54.025421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f047dd76-d38e-46b5-a8ed-e60a02448a6e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1502 microversion: 2.1 time: 0.151891 Jul 14 15:56:54.026024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 121/223] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:53 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:54.042458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:54.043260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:54.050285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.051055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.051836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:54.052249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:54.180118 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:54.187687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d7adf70c-2ff5-4adc-9bfd-8b09bd47a2d0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1516 microversion: 2.1 time: 0.149149 Jul 14 15:56:54.188201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 103/224] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:54 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:54.960585 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-50038700", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "networks": [{"uuid": "a8e188ea-61b9-4236-869e-12775ed6b2c2"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:55.014185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] validate_networks() for [('a8e188ea-61b9-4236-869e-12775ed6b2c2', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:56:55.404641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:56:55.404641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:56:55.404641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:56:55.404641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:56:55.404641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:56:55.410519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.410968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.412322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.412787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.433094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Getting quotas for project 8edf005aaa274e98a3f098e45105c0da. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:55.439068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Getting quotas for user a84d1283721f408d85c0b835d9173daf and project 8edf005aaa274e98a3f098e45105c0da. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:55.449253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:56:55.451603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:56:55.675475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.676317 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.683683 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.684137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.684911 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.685351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.708421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-afbdc00b-509f-4f47-9f0c-8b3f245cbde8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/ips" status: 200 len: 149 microversion: 2.1 time: 0.036737 Jul 14 15:56:55.711395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 104/225] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:56:55.755855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d5eda924-2766-422d-bcb0-084f48c97752 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798877 Jul 14 15:56:55.757143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 122/226] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:56:55.762263 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.763574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.767822 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-18ce358e-c791-407d-80f0-4eff591084ba tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:55.768812 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-18ce358e-c791-407d-80f0-4eff591084ba tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:55.793125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.793608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.794943 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:55.794943 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:55.826964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-12fa7816-1530-4bf6-ade0-7160fd6e1380 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/ips" status: 200 len: 147 microversion: 2.1 time: 0.077563 Jul 14 15:56:55.827604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 105/227] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/ips => generated 147 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:56:55.831663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-18ce358e-c791-407d-80f0-4eff591084ba tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:55.840126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-18ce358e-c791-407d-80f0-4eff591084ba tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1212 microversion: 2.1 time: 0.076273 Jul 14 15:56:55.852909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 123/228] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:55 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.081358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:56.082453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.088560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.089012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.089776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.090244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.112927 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'flavor' on Instance uuid 898f0bbf-f711-46da-a57f-3b09e9d9b926 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:56:56.627540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-488eda41-5008-4f32-895d-959c75bcbb1e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/action" status: 200 len: 32 microversion: 2.1 time: 0.550232 Jul 14 15:56:56.628301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 106/229] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:56:56 2022] POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/action => generated 32 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:56:56.636984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:56.637600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.643688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.644140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.644906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:56.645331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:56.779779 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:56.787991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-36191026-f70d-49ff-80f7-91df26187ccb tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.154795 Jul 14 15:56:56.788571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 124/230] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:56 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:56.863884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-05d41375-08bc-4826-b2b1-3344629ea29c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:56.864672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-05d41375-08bc-4826-b2b1-3344629ea29c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:56.924933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05d41375-08bc-4826-b2b1-3344629ea29c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:56.933516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-05d41375-08bc-4826-b2b1-3344629ea29c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1212 microversion: 2.1 time: 0.073855 Jul 14 15:56:56.934124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 107/231] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:56 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:57.811132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:57.811656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:57.818343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.820068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.820068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.820068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.951246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:57.951978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:57.959139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.959570 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:57.960345 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:57.960779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:58.022425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.030606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5023dc0b-cf71-49e4-8f2f-07b9e452a349 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1216 microversion: 2.1 time: 0.083220 Jul 14 15:56:58.041317 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 108/232] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:57 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:58.268799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:58.276652 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fbef059d-220d-4000-814b-aef2e75d2797 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.469481 Jul 14 15:56:58.277219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 125/233] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:57 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.048768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.049443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.057210 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.057662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.058674 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.059112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.149039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.155613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-df937db4-7122-45e5-96c1-67115a31f74f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1216 microversion: 2.1 time: 0.110619 Jul 14 15:56:59.156154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 109/234] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:59.293075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:59.293693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:59.295581 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:59.300360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.301069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.302369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:59.302813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:59.442920 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:59.450627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d4038914-3afc-4936-9dab-185f5e215807 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.161616 Jul 14 15:56:59.451194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 126/235] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:59 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:00.172733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.173358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.176259 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=40 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:00.181073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.181548 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.182412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.182851 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.270054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:00.277551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c09d3830-526d-474d-8161-d2064b230c1b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1264 microversion: 2.1 time: 0.108986 Jul 14 15:57:00.278166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 110/236] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1264 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:00.467537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.468150 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.475129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.475581 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.476342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.476829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.601720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "425cad83-65fe-40c8-a45c-a99aea25b79c"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:00.603774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.622464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.623567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.625836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.626795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.667181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:00.678455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c0af9945-7297-4801-bfe9-efac7abd0e4e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.214414 Jul 14 15:57:00.679187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 127/237] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:01.295135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.295748 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.302267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.302720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.303495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.303931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.364295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.372179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-16558d9d-f2bf-4e59-ae54-516520405661 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1270 microversion: 2.1 time: 0.081048 Jul 14 15:57:01.372746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 128/238] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:01 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:01.608038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6464b272-4257-491c-86ae-7586fe24a5f9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.011706 Jul 14 15:57:01.608684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 111/239] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:57:00 2022] POST /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:01.695880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.696482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.702494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.702954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.703777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:01.704207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:01.832819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.841023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bb81987c-7172-4b48-bca1-4e8ab389d995 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.149498 Jul 14 15:57:01.841621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 129/240] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:01 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:02.390604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:02.391224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:02.398062 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.398521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.399283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.399726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.403698 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:02.527054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.532372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-34b1fef0-acb3-4f36-ac9e-f3d957ceccaa tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.146657 Jul 14 15:57:02.532953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 112/241] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:02 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:02.858080 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:02.858781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:02.865400 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.865877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.866642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:02.867083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:02.992400 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:02.999939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-081a6d42-cce0-4ca1-a005-89aecf842b91 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.145791 Jul 14 15:57:03.000512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 130/242] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:02 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.548486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.549095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.556437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.556889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.557644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:03.558106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:03.682537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:03.689932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1281f548-ef17-4cb3-bac3-504d0d05c2e0 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.145254 Jul 14 15:57:03.690592 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 113/243] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:04.017388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.018032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.024652 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.025110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.025902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.026345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.158324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.166553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d3667315-d173-4f7f-a7ed-683496084ee5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.153017 Jul 14 15:57:04.167135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 131/244] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:04.707799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.709182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.715634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.715995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.716773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.717257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.808666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.809806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.818960 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.819926 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.821223 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.822144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.847533 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-84b2d408-2318-4a3d-a62f-b914c6f5f909 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/ips" status: 200 len: 150 microversion: 2.20 time: 0.045627 Jul 14 15:57:04.848204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 132/245] 10.222.0.47 () {60 vars in 1288 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:57:04.921271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6230e2ee-30b6-4cf8-a02e-cb9f9ab04ea7"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:04.928336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.929278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.931138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.931685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.932649 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:04.933931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:04.949242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cd12a793-e598-4e2d-bac5-8e8d6fae2bd2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.245565 Jul 14 15:57:04.952540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 114/246] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:05.183833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.184444 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.190407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.190860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.191628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.192067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.337159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:05.344743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b016c266-bad9-45a4-88e2-cfeedbfca8e2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.164765 Jul 14 15:57:05.345319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 115/247] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:05.381438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-48f9857e-2c69-40c5-957e-cda4de7fa810 req-8823abf7-fd93-4dbd-ab58-24f7d94165b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bf9ff2-0601-41b7-a7b5-d4c7cd642838", "tag": "5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:05.390197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-48f9857e-2c69-40c5-957e-cda4de7fa810 req-8823abf7-fd93-4dbd-ab58-24f7d94165b9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.394913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-48f9857e-2c69-40c5-957e-cda4de7fa810 req-8823abf7-fd93-4dbd-ab58-24f7d94165b9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.401795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-48f9857e-2c69-40c5-957e-cda4de7fa810 req-8823abf7-fd93-4dbd-ab58-24f7d94165b9 service nova] Creating event network-changed:5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d for instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 on hv-cinder-83716 Jul 14 15:57:05.406577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-48f9857e-2c69-40c5-957e-cda4de7fa810 req-8823abf7-fd93-4dbd-ab58-24f7d94165b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Jul 14 15:57:05.407286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 116/248] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:05.421396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:05.836529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=8 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:05.970896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.972131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.979275 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.979809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.980748 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.981260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.418007 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.425774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3362a8ac-e69b-4d2f-85c8-2535db69f71a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.459633 Jul 14 15:57:06.426432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 117/249] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:06.431485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:06.432774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:06.438962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.439375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.440153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.440596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.574747 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.582381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5242def5-d092-4b1d-aebd-221fffda5c9a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.154446 Jul 14 15:57:06.583484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 118/250] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:06 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:06.776637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cf2b0d0b-15ee-4a16-b88d-814c983a599c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.860051 Jul 14 15:57:06.777885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 133/251] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:57:04 2022] POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments => generated 194 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:07.443498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:07.444666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:07.446729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:07.452044 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.454405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.454405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.454405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.584484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:07.591879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e459dabf-a1f3-485c-903a-fa38e42ad5be tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.152292 Jul 14 15:57:07.592444 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 119/252] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:07 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.600952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:07.601633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:07.608351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.608808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.609685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.610050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.614314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:07.748566 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:07.756770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3ef2fa7c-4a0c-488e-901b-f7f5bb7f05d5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.160720 Jul 14 15:57:07.757337 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 134/253] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:07 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:08.163544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:08.164083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.170249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.170706 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.171475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.171918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.195725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'flavor' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:57:08.609941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.610658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.618196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.618645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.619410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.619844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.751760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:08.760214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7bd202cf-5c23-4557-88ca-9e8879658f2e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.154520 Jul 14 15:57:08.760791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 135/254] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:08.773580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.774234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.779941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.780444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.781237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.781676 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.822914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1ef5916d-f2d8-4668-8f66-49d81cdf0690 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/action" status: 202 len: 0 microversion: 2.20 time: 0.663182 Jul 14 15:57:08.824625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 120/255] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 14 15:57:08 2022] POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:57:08.840003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.844384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.847420 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.847953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.849406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.849946 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.941706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:08.957629 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8470e3a2-9ee1-4640-8c91-9553c3c70e93 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.188067 Jul 14 15:57:08.958909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 136/256] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:08.996016 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.004184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.006321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.007515 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-28b6f45b-961e-400e-9999-d1e731d6a920 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.178158 Jul 14 15:57:09.008655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 121/257] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:09.777593 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:09.778296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:09.785251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.785708 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.787112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.787611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.975659 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:09.982572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:09.982858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.991740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cb6e6099-c9f5-4503-8e8f-149f7be83394 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.217964 Jul 14 15:57:10.001528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.001731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 137/258] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:09 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:10.001875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.001875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.001875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.028623 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.029163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:10.044563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.045033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.045866 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:10.046322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:10.134465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.142098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-408dc9ad-6417-4aaf-b113-67d7f884f485 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.170906 Jul 14 15:57:10.142678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 122/259] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:09 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:10.241291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.260743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.269949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:10.269949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3cfde2a4-5b2e-4e9b-b4fb-abb80285f06b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.239691 Jul 14 15:57:10.269949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 138/260] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:11.009136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:11.009855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.016565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.017105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.017977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.018517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.160062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:11.162078 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.169319 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.170027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.171002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.171611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.187017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.196747 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-54361811-ff5b-45e5-9c7b-37416f2f1f34 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.191685 Jul 14 15:57:11.197490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 123/261] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:11 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:11.282878 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:11.283595 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.290048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.290658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.291507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.292037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.312429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.322211 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b4f538f3-f017-40e8-8f94-bc1bb57c033b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.166066 Jul 14 15:57:11.322998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 139/262] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:11 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:11.435774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.444271 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.445798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.446995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6311bcc4-c180-4ae6-8e01-6f62d9bc1b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.168021 Jul 14 15:57:11.447589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 124/263] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:11 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:12.214426 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.215037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.221584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.222070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.222835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.223264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.340041 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.340795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.347505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.347958 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.348772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.349991 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.365540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.373247 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c934f429-3995-4cef-8b25-0c70dceac162 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.162799 Jul 14 15:57:12.373884 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 140/264] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:12.465865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.466526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.472490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.472946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.473720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.474227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.487562 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.495641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5a792321-493f-4ce8-b135-7982061e23f6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.159660 Jul 14 15:57:12.496213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 125/265] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:12.603650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.611700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.613279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.614959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-37d68d62-1342-4afa-a189-17beb9993a4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.153331 Jul 14 15:57:12.615529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 141/266] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:13.391984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.391984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.398625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.399021 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.399798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.400236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.494164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1344156015", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "networks": [{"uuid": "87cdf084-dc76-42c2-ae63-5e71b86be3a9"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:13.554410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] validate_networks() for [('87cdf084-dc76-42c2-ae63-5e71b86be3a9', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:13.560116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.568574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-99eb3ed1-c1a8-461f-b007-9df68d723149 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.181677 Jul 14 15:57:13.569294 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 126/267] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:13.574328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.575251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.583999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.584577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.586841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.586841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.610744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:13.745877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.762884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-266b10a8-fc7c-49c1-9a70-4cc7d50e7ed4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.192183 Jul 14 15:57:13.764306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 127/268] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:13.778998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.779753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.786351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.786930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.787814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.788356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.950461 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.965040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.966938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.968115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ccefe0ed-7279-4a8f-862f-18d0d5974573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.193099 Jul 14 15:57:13.968677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 128/269] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:13.973272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-92e6377c-830e-4ffb-882a-cebce922d014 req-f0e2cfca-ac6f-491c-af7a-9685972c1a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bf9ff2-0601-41b7-a7b5-d4c7cd642838", "name": "network-vif-plugged", "status": "completed", "tag": "5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:13.987650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-92e6377c-830e-4ffb-882a-cebce922d014 req-f0e2cfca-ac6f-491c-af7a-9685972c1a9e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.988103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-92e6377c-830e-4ffb-882a-cebce922d014 req-f0e2cfca-ac6f-491c-af7a-9685972c1a9e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.998203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:13.998627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:13.999444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:13.999792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:14.000202 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:14.009495 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-92e6377c-830e-4ffb-882a-cebce922d014 req-f0e2cfca-ac6f-491c-af7a-9685972c1a9e service nova] Creating event network-vif-plugged:5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d for instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 on hv-cinder-83716 Jul 14 15:57:14.015019 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-92e6377c-830e-4ffb-882a-cebce922d014 req-f0e2cfca-ac6f-491c-af7a-9685972c1a9e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044872 Jul 14 15:57:14.017545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.017999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.018961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 129/270] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:14.020596 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.021064 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.037537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9a455f3f-bb2e-40c9-b445-a2ba1d5f08c5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: .version_select at 0x7f340417ea60>, body: {"keypair": {"name": "tempest-keypair-639708616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY7xzdTIc7VxLyK7rDEs+AF68v5W/zNteZ4vQ1AdNyATzzuuYo7DMIhFzASDHItKWUK3ykV6A24IBzcZfW54KT+6uO+xPKaAbjTgXWNwKURYDo686jDaH4aXuA6lcCqJw=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:14.044249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Getting quotas for project d16ae801ca124180b78f2fce16acc4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:14.048637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Getting quotas for user 54fcab272d7946c69aac92f6d3030942 and project d16ae801ca124180b78f2fce16acc4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:14.054897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-9a455f3f-bb2e-40c9-b445-a2ba1d5f08c5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:14.059147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-9a455f3f-bb2e-40c9-b445-a2ba1d5f08c5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:14.061997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:14.065201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:14.177162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9a455f3f-bb2e-40c9-b445-a2ba1d5f08c5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143192 Jul 14 15:57:14.177753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 130/271] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:57:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:14.213324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e5e66f55-9bb7-4987-8097-653dbc240c93 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723128 Jul 14 15:57:14.215858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 142/272] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:57:14.224278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-31789677-5903-4169-bcea-0bb3ab5d5d23 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.225047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-31789677-5903-4169-bcea-0bb3ab5d5d23 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.278654 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31789677-5903-4169-bcea-0bb3ab5d5d23 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.285836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-31789677-5903-4169-bcea-0bb3ab5d5d23 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1219 microversion: 2.1 time: 0.065479 Jul 14 15:57:14.286451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 131/273] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.586507 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.587146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.593930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.594376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.595129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.595563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.735574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.743859 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ab6dd22e-93f8-4398-8b49-b143664bb5d5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.161935 Jul 14 15:57:14.744427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 143/274] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.780522 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.781143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.788742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.789236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.790053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.790496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.922315 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.930121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bad1f0a6-68ce-45f2-a1ef-fa4d1019bb8b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.153566 Jul 14 15:57:14.930693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 132/275] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:14.992410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.993017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.999035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.999482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.000275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.000707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.136834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.146359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.147858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.149255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce2374f8-89ca-491e-b5c8-3d4c34da32fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.160762 Jul 14 15:57:15.149845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 144/276] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:15.303676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e19e54d6-4ab5-4364-baae-0191434b608e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.304302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e19e54d6-4ab5-4364-baae-0191434b608e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.358148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e19e54d6-4ab5-4364-baae-0191434b608e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.365347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e19e54d6-4ab5-4364-baae-0191434b608e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1219 microversion: 2.1 time: 0.066376 Jul 14 15:57:15.366993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 133/277] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:15.760813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.761330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.768020 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.768472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.769240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.769679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.902852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:15.910327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a81ceb81-ef51-49b0-bdef-ce4fbb11c44a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.153429 Jul 14 15:57:15.910912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 145/278] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:15.947672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.948292 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.954990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.955454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.956239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.956684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.105067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.112624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-31784884-fa3f-45b9-86ac-698bdce30456 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.168860 Jul 14 15:57:16.113203 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 134/279] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:16.167669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.168286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.174565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.175747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.176711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.177154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.308685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.316709 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.318938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.320099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6bde3ec2-f2f8-4da7-89bb-a0c08a84ffa7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.156954 Jul 14 15:57:16.320665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 146/280] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:16.382716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.383364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.389389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.389870 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.390647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.391091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.483609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.491649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f8918247-5557-4e64-a29f-b27845bae0c6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1223 microversion: 2.1 time: 0.113497 Jul 14 15:57:16.492221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 135/281] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:16.928689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:16.929403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:16.933223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-969222011", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761c7f07-2b9f-4965-8183-b20363082c34"}], "security_groups": [{"name": "tempest-securitygroup--1568937624"}], "key_name": "tempest-keypair-639708616", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:16.936221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.936674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.937443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:16.937945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.039667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] validate_networks() for [('761c7f07-2b9f-4965-8183-b20363082c34', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:17.075148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.083190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-dbc1525b-7bc2-4af0-8e29-22864bce5f0c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.159065 Jul 14 15:57:17.083768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 147/282] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:16 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.128709 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.129320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.135342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.135790 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.136552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.136988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.268111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.276213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-aae05ca3-70be-415b-9200-ffddf7e734b2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.151357 Jul 14 15:57:17.276782 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 148/283] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:17.337939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.338548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.344484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.344934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.345694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.346161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.415617 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:17.416120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:17.416711 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:17.417241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:17.417724 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:17.427111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.427560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.428469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.428905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.446274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:17.450492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:17.461788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:17.464182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:17.479241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.488352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.490500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.491662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-764762a8-b569-4223-bab5-4a9dc4d4343b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.157608 Jul 14 15:57:17.492213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 149/284] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:17.508195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.508797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.520675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.520675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.520675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.520675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.579260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.586853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c400b658-5ea3-417c-b8a7-50c0afc681b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1223 microversion: 2.1 time: 0.082341 Jul 14 15:57:17.587437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 150/285] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:17.665123 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0b94c693-66b4-4334-bd7a-a927beeaab8f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736174 Jul 14 15:57:17.665957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 136/286] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:57:17.676500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-325ab14e-499b-40ad-b1b2-c90fe6510404 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.677122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-325ab14e-499b-40ad-b1b2-c90fe6510404 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.730799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-325ab14e-499b-40ad-b1b2-c90fe6510404 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.737655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-325ab14e-499b-40ad-b1b2-c90fe6510404 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1240 microversion: 2.1 time: 0.065352 Jul 14 15:57:17.738272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 151/287] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:18.099928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.100552 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.111023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.111486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.112299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.112745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.245970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.262064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-08d52fe2-af89-4e41-811b-56a97558c5b1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.165668 Jul 14 15:57:18.264505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 137/288] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:18.293012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.293647 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.301530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.302506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.303275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.303704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.321158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:18.435405 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.442862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6230080c-5fd7-417f-aefc-d18b4e5ec5a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.153762 Jul 14 15:57:18.443423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 152/289] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:18.510291 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.511090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.516863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.517404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.518214 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.518657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.604366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.604976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.615102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.615553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.616332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.616860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.653490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.670784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.672296 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.673760 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c0a425c1-0bbc-4194-89d2-d129a25c9020 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.167648 Jul 14 15:57:18.674599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 138/290] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:18.682562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.690136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e78d25cd-58b8-4e7c-88a4-17e80ab20322 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1215 microversion: 2.1 time: 0.089667 Jul 14 15:57:18.690693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 153/291] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:18.755366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:18.755979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:18.762089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.762490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.763255 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:18.763693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:18.823894 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:18.831083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e551e710-5bcb-47fa-bb4e-600e7dc30594 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1244 microversion: 2.1 time: 0.079623 Jul 14 15:57:18.831644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 139/292] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:18 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:19.280486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.281093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.287577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.288017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.288774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.289205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.420894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.431030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce0e0acb-15ed-4fc1-8111-77de1d92d3f8 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1312 microversion: 2.1 time: 0.154177 Jul 14 15:57:19.431616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 154/293] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:19.460282 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.460891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.467348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.469773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.469773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.469773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.602382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.610134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-87092e60-2347-4907-9383-e93adb368b3c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.154144 Jul 14 15:57:19.610741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 140/294] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:19.698808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.699640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.708377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.709327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.712539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.716265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.716610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.716720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.717548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.717657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.718082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.718346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.788094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.797171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-eeb6e62a-ec26-4089-b8fe-f9ed94369a35 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1215 microversion: 2.1 time: 0.094311 Jul 14 15:57:19.798128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 141/295] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:19.848378 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:19.849105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:19.855986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.856458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.857261 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.857702 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.865410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.873564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.887657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.887657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8e9699a9-4588-4b32-97a4-29a99a464c5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.183047 Jul 14 15:57:19.887657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 155/296] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:19.920296 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:19.928035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-78a8ae6d-e907-4ee1-b95f-32e118ce62a2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1244 microversion: 2.1 time: 0.083583 Jul 14 15:57:19.928742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 142/297] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:19 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:20.447446 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.447977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.454610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.455062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.455876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.456342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.586193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.593682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1037d36e-35ca-45d4-b263-70fcdb31378d tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1495 microversion: 2.1 time: 0.150220 Jul 14 15:57:20.594327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 156/298] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1495 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.626987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.627661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.634284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.634742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.635523 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.635966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.765999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.774489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b890c77e-37cf-4785-b035-d75bb74a2c30 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.151405 Jul 14 15:57:20.775057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 143/299] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.814353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.814969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.821641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.822783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.823551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.823992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.887614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:20.894616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.895655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bf8e56c8-8f85-4561-b443-e8ac120e36b8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.084561 Jul 14 15:57:20.895770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.896230 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 157/300] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:20.901714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.902202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.902964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.903402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.944370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:20.944985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:20.951133 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.951587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:20.954047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:20.954047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.013476 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.021439 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8cb7957e-66d2-4a46-98ea-c714ecf5d39c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1236 microversion: 2.1 time: 0.080867 Jul 14 15:57:21.022034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 158/301] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:21.035627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.044524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.046074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.047360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c6f71682-e8d3-405c-9686-629afe88eae5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.156685 Jul 14 15:57:21.047931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 144/302] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:20 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:21.791263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.791932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.800575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.801037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.801835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.802308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.913244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:21.917753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:21.917753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:21.921215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.921675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.922479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:21.922922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:21.945026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.953005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3bc86e34-131e-4c13-b87e-de9edf6f1e52 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.165540 Jul 14 15:57:21.960807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 159/303] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:21.985719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:21.994304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2d9347aa-c20a-46fe-90db-347ba1d31eac tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.085713 Jul 14 15:57:22.000893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 145/304] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:21 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:22.039069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.039680 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.045776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.046204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.046973 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.047415 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.066273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.066960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.073507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.074087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.074848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.075281 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.110542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.118742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0379865f-00c1-4965-ae70-2a083a7cf47e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1236 microversion: 2.1 time: 0.084029 Jul 14 15:57:22.119314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 160/305] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:22.203532 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.211496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.213097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:22.214287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5a21fa3b-169b-4bc7-bea8-80a1062e81cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.151897 Jul 14 15:57:22.217865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 146/306] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:22.970044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:22.970655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:22.977109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.977563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:22.978355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:22.978794 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.015481 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:23.016101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:23.022705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.023160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.023938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.024376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.092259 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.099889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2ee7017f-3a56-47ae-85a3-66836d365f62 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.088096 Jul 14 15:57:23.100393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 147/307] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:23 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:23.112595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.120524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3379d2af-f57b-4321-ac5e-3ad3e7f00430 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.154387 Jul 14 15:57:23.121110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 161/308] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:22 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:23.135947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:23.136555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:23.142552 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.143004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.143761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.144196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.161383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:23.203528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.210786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5e5235d9-dcec-4ad1-8386-1cd5c88fd7f6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1236 microversion: 2.1 time: 0.078615 Jul 14 15:57:23.211349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 148/309] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:23 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:23.232227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:23.232835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:23.238767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.239731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.240474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:23.240909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:23.366459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.374308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.375812 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:23.376958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-eef4f7be-f801-4821-a591-31569dd40a85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.148585 Jul 14 15:57:23.377516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 162/310] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:23 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:24.117362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.118093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.124858 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.125394 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.126207 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.126651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.135595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.136112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.138412 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:24.143310 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.148801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.148801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.148801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.171545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:57:24.191915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.199539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-26cad2cb-16dc-4ab8-b549-beb5ab35f2ff tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.086986 Jul 14 15:57:24.200334 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 149/311] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:24.204659 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.205267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.211095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.211551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.212379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.212827 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.349303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.357069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-05739d3d-7257-4d48-b7ad-7073d812dbd3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.155886 Jul 14 15:57:24.369095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 150/312] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:24.369095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.369095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.369095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.369527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.370287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.370725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.439678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.447848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-02fe56f4-75ce-4edd-a8f6-fd8ca50d6cbb tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1292 microversion: 2.1 time: 0.089076 Jul 14 15:57:24.448765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 151/313] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:24.453089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.453682 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.459728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.460224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.461028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.461465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.537596 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-66aa055d-cbd5-4c9c-9a8a-8961219e60ab tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 204 len: 0 microversion: 2.1 time: 0.405561 Jul 14 15:57:24.538477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 163/314] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:57:24 2022] DELETE /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:57:24.546816 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:24.547520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:24.554146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.558704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.558704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:24.558704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:24.604005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.615037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.616593 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.617786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-503bb3a0-9fc1-46dd-ace0-27ac562703cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.168220 Jul 14 15:57:24.618414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 152/315] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:24.701787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:24.709983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-719ef5da-a5b6-45f5-b6b9-504c7440f1e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1501 microversion: 2.1 time: 0.167119 Jul 14 15:57:24.713344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 164/316] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:24 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:25.215793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.216374 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.223066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.224023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.224788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.225230 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.287166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.294610 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7dcaf6b6-516c-4617-9781-c6e90c397ea5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.082862 Jul 14 15:57:25.295175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 153/317] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:25.374284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.374928 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.377363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:25.382776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.383281 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.384047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.384486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.464948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.465564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.471790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.472172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.472951 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.473973 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.513642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.522301 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2d5a33b3-333f-4713-b9c6-52c3ae7b5341 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.151955 Jul 14 15:57:25.524679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 165/318] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:25.534236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.542100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4ea014ca-7414-44a4-9135-b1fc1edc82c9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1292 microversion: 2.1 time: 0.081195 Jul 14 15:57:25.542661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 154/319] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:25.635565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.635976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.642460 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.642917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.643691 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.644130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.728223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:25.728821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:25.734937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.735387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.736154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:25.736589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:25.777921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.786528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.788045 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.789202 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d5c6de1b-c437-46f1-a68a-db8868144b8d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.157730 Jul 14 15:57:25.789767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 166/320] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:25.871383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:25.879405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9d87f709-2780-4998-93da-3231254bc745 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1501 microversion: 2.1 time: 0.155058 Jul 14 15:57:25.888822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 155/321] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:25 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:26.311599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.312249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.319183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.319640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.320408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.320848 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.342766 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:26.385079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.393431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-22e670b2-9f05-41fd-acf1-881cc63fe383 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1271 microversion: 2.1 time: 0.085701 Jul 14 15:57:26.394034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 167/322] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.540719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.541349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.548450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.551922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.551922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.551922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.565038 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.565776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.572410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.572867 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.573637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.574106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.639120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.646502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8eb35de7-e580-4ff2-985c-e6f01ff8ed10 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1292 microversion: 2.1 time: 0.089108 Jul 14 15:57:26.647090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 168/323] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:26.687983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.695883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-11c7959b-38bb-435c-8fc7-2b9b960c64fd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.159319 Jul 14 15:57:26.696446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 156/324] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:26.808641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.809249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.815816 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.816269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.817615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.818093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.896299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:26.897035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:26.903587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.904116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.904892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:26.905327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:26.959324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.973259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.975379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:26.976558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0ea1b6aa-488b-43a4-a46f-38d205536739 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.172397 Jul 14 15:57:26.980839 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 169/325] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:27.048319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.057873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ee8f5305-7b6b-4114-8615-fcd390fcb796 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1501 microversion: 2.1 time: 0.166022 Jul 14 15:57:27.063226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 157/326] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:26 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:27.175848 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7eb17aac-6096-4a7f-bbb1-4ae722751150 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:27.182353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb17aac-6096-4a7f-bbb1-4ae722751150 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.183642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb17aac-6096-4a7f-bbb1-4ae722751150 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.241838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7eb17aac-6096-4a7f-bbb1-4ae722751150 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Going to try to stop instance {{(pid=129992) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:57:27.412000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.412535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.418565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.422930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.422930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.422930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.438068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.454611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7eb17aac-6096-4a7f-bbb1-4ae722751150 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action" status: 202 len: 0 microversion: 2.1 time: 0.282741 Jul 14 15:57:27.458383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 170/327] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:57:27 2022] POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:57:27.458636 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=14 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.464775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.465483 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.471904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.472388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.473163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.473600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.506148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.513778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-980b3063-9c13-43b9-bc0b-879f3153ef3f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1279 microversion: 2.1 time: 0.105685 Jul 14 15:57:27.514390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 158/328] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:27.618049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.627024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ab1646d8-b602-4b51-a2dc-435f4f50b44a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.166299 Jul 14 15:57:27.627607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 171/329] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:27.664478 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.665749 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.672490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.673022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.673896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.674420 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.712810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:27.713545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.719690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.720249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.721087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.721601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.735494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=8 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.806497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.816211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cb61ab7f-b44a-459d-8167-950292fb8c38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1300 microversion: 2.1 time: 0.156505 Jul 14 15:57:27.825960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 159/330] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:27.885635 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:27.896882 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d5a4dd61-1f2d-441f-a6fd-9d68a4491f71 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1502 microversion: 2.1 time: 0.187804 Jul 14 15:57:27.897461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 172/331] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:27.913874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9be4e407-36b8-4d1c-8657-a3d8fa058d6d"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:27.915051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.921568 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.922141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.923038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.923550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.948146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] HTTP exception thrown: Cannot 'attach_volume' instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 while it is in vm_state rescued Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Request method failure captured: Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/os-volume_attachments HTTP/1.1 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 74 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxhUXoajOhh3ceVHksOZo9mrBJutckJmhJIeA0AAOAqzhvwYY2Oa7aqCfQvOPi1CHYnXizlJsZjgFaYJ72iXNuHRDRUdJA1kkOeNxnEy1tBVSXiCs4AqVdH1hg9qJlEgV5sF3QgMH7PhkOWWJ-QiJoqNH4nUPM3oQ20nXWLayZ5EEg Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 15:57:27.950648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_508fd5c51f544a3db6d0b87e37750e01", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/508fd5c51f544a3db6d0b87e37750e01"}]}] Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 81ca45714ee44a549fd002b4aa13973b Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {"volumeAttachment": {"volumeId": "9be4e407-36b8-4d1c-8657-a3d8fa058d6d"}} Jul 14 15:57:27.952145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Cannot 'attach_volume' instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 while it is in vm_state rescued Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'server_id': '898f0bbf-f711-46da-a57f-3b09e9d9b926', 'body': {'volumeAttachment': {'volumeId': '9be4e407-36b8-4d1c-8657-a3d8fa058d6d'}}} Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:57:27.953132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 while it is in vm_state rescued Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:57:27.954516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 while it is in vm_state rescued Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Returning 409 to user: Cannot 'attach_volume' instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 while it is in vm_state rescued {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7d813f0b-bd77-4c3a-a5c6-fffeb6b339f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044046 Jul 14 15:57:27.956829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 160/332] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:57:27 2022] POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:57:27.966328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:27.973770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:27.974019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.974474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:27.975240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:27.975671 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.000069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.000952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.008333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.009154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.010213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.011257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.283090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-601061c9-4810-489c-9e38-fb885e939cf1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/action" status: 202 len: 0 microversion: 2.1 time: 0.321587 Jul 14 15:57:28.283892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 173/333] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:57:27 2022] POST /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:57:28.289225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.290022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.296216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.296661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.297423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.297871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.443862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.453018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-00444c7c-ac59-43db-859d-a63fea5adb51 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1501 microversion: 2.1 time: 0.168004 Jul 14 15:57:28.453735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 174/334] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:28.459734 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.460350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.466778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.467233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.468292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.468732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.609498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.615399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.618044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7eb283d3-23ce-4d69-a04b-25959e5ad5bd tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1510 microversion: 2.1 time: 0.163221 Jul 14 15:57:28.618712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 175/335] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:28.626080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.627722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.630421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e4a0feb6-be7f-41a9-a5a2-0d1cc14f4873 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.633348 Jul 14 15:57:28.632578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 161/336] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:27 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:28.637058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.637058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.641671 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.643613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.644379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.644814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.650152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.651660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.659934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.660480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.662027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.666720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.708569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.716189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d5a234f5-fe79-402b-bcb3-72c52091ce06 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1277 microversion: 2.1 time: 0.087289 Jul 14 15:57:28.716778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 176/337] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:28.838587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:28.839200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:28.845353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.845800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.846599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:28.847034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:28.915691 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:28.923537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-eac7f9af-02e9-4bf8-82cd-77dd15754721 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1298 microversion: 2.1 time: 0.088783 Jul 14 15:57:28.924544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 177/338] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:29.072774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.081914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-92a2a442-8161-42c0-8a64-a06a93545af7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.439018 Jul 14 15:57:29.083034 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 162/339] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:28 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:29.468384 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-14b367e3-6e05-4ac2-b5e8-4a526a7b005a req-ca412023-31ac-432b-a405-26ab19874a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bf9ff2-0601-41b7-a7b5-d4c7cd642838", "name": "network-vif-deleted", "tag": "5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:29.472862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.474592 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.476989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-14b367e3-6e05-4ac2-b5e8-4a526a7b005a req-ca412023-31ac-432b-a405-26ab19874a4d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.477629 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-14b367e3-6e05-4ac2-b5e8-4a526a7b005a req-ca412023-31ac-432b-a405-26ab19874a4d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.485955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.489805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.489805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.489805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.490113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-14b367e3-6e05-4ac2-b5e8-4a526a7b005a req-ca412023-31ac-432b-a405-26ab19874a4d service nova] Creating event network-vif-deleted:5d11b400-2c5a-4fda-ad5f-6b7e8a6c1a0d for instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 on hv-cinder-83716 Jul 14 15:57:29.496638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-14b367e3-6e05-4ac2-b5e8-4a526a7b005a req-ca412023-31ac-432b-a405-26ab19874a4d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Jul 14 15:57:29.497634 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 178/340] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:29.608678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.619666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-632eb808-ee69-493a-a8aa-67eb44176312 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1459 microversion: 2.1 time: 0.152097 Jul 14 15:57:29.620350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 163/341] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:29.638248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.639100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.646865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.647598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.648508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.648948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.652700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.653308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.669583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.671124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.672375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.673155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.841809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:29.851437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3191ea65-0f29-4def-a686-870f3f6072c2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1510 microversion: 2.1 time: 0.219032 Jul 14 15:57:29.861743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 179/342] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:29.867396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:29.868009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:29.874637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.875618 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:29.876638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:29.877087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.078662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.088195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4bf6b200-cbf7-44f4-ab7a-1ad09c1b5e5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.225018 Jul 14 15:57:30.088769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 180/343] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.094601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.094601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.099989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.100442 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.101207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.101643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.116612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.126222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.128212 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.130336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d6284e86-2c11-4cc9-b627-77308b3982bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.480920 Jul 14 15:57:30.130902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 164/344] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:29 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:30.145554 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.146436 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.153411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.154023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.154885 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.155411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.165690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.175734 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-10634905-f817-4d9a-9bd0-2dd6cdfb4daa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1298 microversion: 2.1 time: 0.085644 Jul 14 15:57:30.177180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:30.178536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 181/345] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.489669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.499843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bbd68450-2e89-4f7a-9de4-8208c641d922 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.367612 Jul 14 15:57:30.500773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 165/346] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.638749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.639946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.648852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.649731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.650637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.651177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.685330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.685913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.686436 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lazy-loading 'fault' on Instance uuid 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:57:30.693120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:30.738093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:30.752429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ff056bff-f484-41f5-81c9-e8ae06a6784e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 200 len: 1302 microversion: 2.1 time: 0.113754 Jul 14 15:57:30.752429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 182/347] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:30.868862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:30.882003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:30.882003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.882003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:30.882003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:30.882381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.105282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.105856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.112842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.121472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.121666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cdcf79aa-93e5-4af9-a3d1-4e7905a679bc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1510 microversion: 2.1 time: 0.256363 Jul 14 15:57:31.121976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.123137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 166/348] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:30 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:31.131396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.131959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.152285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.152912 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.161039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.161565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.163852 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.163852 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.278637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.286568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-10096d8f-a1e5-4e96-8e7c-70e74f1ed8e7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.184811 Jul 14 15:57:31.287146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 183/349] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:31.291595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.292191 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.298265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.298721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.299549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.299991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.316453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.324396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.325926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.327105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3152e7ac-e143-41d0-9382-671d2b9f65cb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.182055 Jul 14 15:57:31.327636 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 167/350] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:31.431553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.439181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f86b3916-a1b6-4abe-851b-2bcaa3b998ca tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.150952 Jul 14 15:57:31.439767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 184/351] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:31.517489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.518160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.525124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.525584 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.526395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.526838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.705085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-7a4408d9-0ce8-4766-84c1-3f65fd7ce3ad req-dd79efc0-0fc7-4580-bc04-4d1276e4031f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985107cf-7ae3-42a1-8669-ea261e1b1c2d", "tag": "3943d8e5-7af8-4ed5-937d-4c847a3532ef"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:31.714135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7a4408d9-0ce8-4766-84c1-3f65fd7ce3ad req-dd79efc0-0fc7-4580-bc04-4d1276e4031f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.714587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7a4408d9-0ce8-4766-84c1-3f65fd7ce3ad req-dd79efc0-0fc7-4580-bc04-4d1276e4031f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.726074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-7a4408d9-0ce8-4766-84c1-3f65fd7ce3ad req-dd79efc0-0fc7-4580-bc04-4d1276e4031f service nova] Creating event network-changed:3943d8e5-7af8-4ed5-937d-4c847a3532ef for instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d on hv-cinder-83716 Jul 14 15:57:31.731181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-7a4408d9-0ce8-4766-84c1-3f65fd7ce3ad req-dd79efc0-0fc7-4580-bc04-4d1276e4031f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029841 Jul 14 15:57:31.731783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 185/352] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:31.765000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:31.765703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: 45bf9ff2-0601-41b7-a7b5-d4c7cd642838] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:31.772103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.772557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.773331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:31.773781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:31.787835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] HTTP exception thrown: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Request method failure captured: Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 HTTP/1.1 Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DzEI_6YQUir2ng43q__V-dDzEYAMpfJ7VwfjGxJXBGOKJHa_2l0qxjxZMfm7dFzVUOmOg8TQDeJxNaNKnE4BqHlYUGq16LekKpco2Ov6ZkWU2Q4i9m-3gjhCap9LBVii7vZ0P3Hl7k3G8CHedL62bNupSf6yML0S7zMCwqbZ5UdB-Q Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 8edf005aaa274e98a3f098e45105c0da Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesActionsTest-1824099171 Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:57:31.789479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8edf005aaa274e98a3f098e45105c0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8edf005aaa274e98a3f098e45105c0da", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8edf005aaa274e98a3f098e45105c0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8edf005aaa274e98a3f098e45105c0da"}]}] Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesActionsTest-1824099171 Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 8edf005aaa274e98a3f098e45105c0da Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesActionsTest-1824099171 Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesActionsTest-1824099171-project Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: a84d1283721f408d85c0b835d9173daf Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesActionsTest-1824099171-project Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. Jul 14 15:57:31.790937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '45bf9ff2-0601-41b7-a7b5-d4c7cd642838'} Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:57:31.792005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. Jul 14 15:57:31.793408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:57:31.794677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Returning 404 to user: Instance 45bf9ff2-0601-41b7-a7b5-d4c7cd642838 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:57:31.794677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f40ebcb5-7f2d-46a2-9855-53fcbdbbdac4 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838" status: 404 len: 111 microversion: 2.1 time: 0.030140 Jul 14 15:57:31.794677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 186/353] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/45bf9ff2-0601-41b7-a7b5-d4c7cd642838 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:57:31.867859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:31.877577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e75a7b88-5407-48e7-adcb-9808327598e9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.364059 Jul 14 15:57:31.878497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 168/354] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:31 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:31.904109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1486573429", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "networks": [{"uuid": "a8e188ea-61b9-4236-869e-12775ed6b2c2"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:31.956206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] validate_networks() for [('a8e188ea-61b9-4236-869e-12775ed6b2c2', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:32.139249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.140503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.150022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.150575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.151519 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.152298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.434251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:32.434682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:32.435164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:32.435616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:32.436035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:32.446176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.446698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.447611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.448167 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.466966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Getting quotas for project 8edf005aaa274e98a3f098e45105c0da. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:32.471057 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Getting quotas for user a84d1283721f408d85c0b835d9173daf and project 8edf005aaa274e98a3f098e45105c0da. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:32.478415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.484093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:32.486557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:32.487324 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5730d13d-e299-450b-9ebf-4a20ab69ecc2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1510 microversion: 2.1 time: 0.352970 Jul 14 15:57:32.488078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 169/355] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:32.493004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.493992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.502067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.502525 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.503338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.512853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.626847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7d995074-ebc5-4905-a364-35a21b8d7ea5 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726484 Jul 14 15:57:32.633473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 187/356] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:57:32.639491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.639491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.661310 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.661763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.662565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.662998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.725700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.736133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ea2e1e4a-7ffa-48c5-a7db-328947bc0bfc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.246784 Jul 14 15:57:32.736769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 170/357] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:32.744679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.746126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.752400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.752933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.753835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:32.754383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:32.854925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.869164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.872238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.874699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-54066f4f-7c59-4946-9c18-63be0e7f03e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.240987 Jul 14 15:57:32.875700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 188/358] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:32.883586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9e3bbdcd-1e60-4c89-b000-a6ab9e12c7f7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.884983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9e3bbdcd-1e60-4c89-b000-a6ab9e12c7f7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.948218 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9e3bbdcd-1e60-4c89-b000-a6ab9e12c7f7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.957173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9e3bbdcd-1e60-4c89-b000-a6ab9e12c7f7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1214 microversion: 2.1 time: 0.079722 Jul 14 15:57:32.965287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:32.968505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 189/359] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:32.975154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:32.975801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:32.979575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-43222c29-6f14-4cfc-9cc6-26c84621049e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.241279 Jul 14 15:57:32.981340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 171/360] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:33.000276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.000997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.002068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.002849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.233117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.244176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-47f363b3-f1b5-4850-b4ee-743527b10550 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.274432 Jul 14 15:57:33.247571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 190/361] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:32 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:33.506476 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:33.507152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:33.514092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.514608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.516438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.516925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.722691 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.730952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b96d82c5-30e3-4783-89b8-979246619dc0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1516 microversion: 2.1 time: 0.230193 Jul 14 15:57:33.731538 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 172/362] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:33.754307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:33.755710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:33.765089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.765470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.765692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-53060764-3975-4aad-8c83-cbcf31451c25 req-846b7676-3376-4ded-8c43-9fb7a97a90f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd607e1d-a8e4-4d78-9624-ca81454a3b76", "tag": "ce7c554f-9081-45fc-b4d3-8e80e04e0129"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:33.766282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.766748 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.779359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-53060764-3975-4aad-8c83-cbcf31451c25 req-846b7676-3376-4ded-8c43-9fb7a97a90f9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.779359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-53060764-3975-4aad-8c83-cbcf31451c25 req-846b7676-3376-4ded-8c43-9fb7a97a90f9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.790365 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-53060764-3975-4aad-8c83-cbcf31451c25 req-846b7676-3376-4ded-8c43-9fb7a97a90f9 service nova] Creating event network-changed:ce7c554f-9081-45fc-b4d3-8e80e04e0129 for instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 on hv-cinder-83716 Jul 14 15:57:33.795363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-53060764-3975-4aad-8c83-cbcf31451c25 req-846b7676-3376-4ded-8c43-9fb7a97a90f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033920 Jul 14 15:57:33.796136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 173/363] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:33.898808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:33.899913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:33.915625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.916168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.918513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:33.919847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:33.978016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:33.987110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-57d9da85-4f21-4a28-b184-33cfc7bf7f2b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.236861 Jul 14 15:57:33.996534 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 191/364] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.001811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.002467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.009282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.014194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.014194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.014194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.108179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.119721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5471934e-fa22-4526-8ae2-e32f731b6667 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1218 microversion: 2.1 time: 0.121764 Jul 14 15:57:34.120569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 192/365] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.125388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.126561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.133385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.133980 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.134841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.135369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.182357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.199626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.202512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.203938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2e51392d-1425-49a5-8958-f2bf3340fd26 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.313489 Jul 14 15:57:34.205037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 174/366] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:33 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:34.261482 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:34.262373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:34.269101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.270493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.271315 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:34.271768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:34.303874 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.312728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-223b5f00-0c02-4eae-a656-989724c00ffd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.190928 Jul 14 15:57:34.313531 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 193/367] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:34.420186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:34.428822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-603a5ae2-0a99-47f3-8d3d-9eb46161ea23 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.171458 Jul 14 15:57:34.429388 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 175/368] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:35.003493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.004390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.011956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.012483 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.013594 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.020349 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.136647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.137264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.146439 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.146439 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.147535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.148150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.148727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.156815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-45a37311-bf32-46cb-94b6-45d8aa230ac3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.157247 Jul 14 15:57:35.157612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 194/369] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:34 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:35.221147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.224065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.224729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.232315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.233004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.233240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a75181e0-f00d-47ac-8e1c-142022f29636 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1210 microversion: 2.1 time: 0.100303 Jul 14 15:57:35.235012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.235790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 176/370] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:35.236460 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.330968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.331848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.338709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.339163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.340148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.340580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.383356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.391576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.393088 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.395780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-289d8487-d87a-413b-8697-52517c90913b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1741 microversion: 2.20 time: 0.175508 Jul 14 15:57:35.396355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 195/371] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:35.449351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:35.450257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:35.456616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.457063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.458424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:35.458857 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:35.481431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.489125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-65ff703b-8dfc-4a9f-a87b-84ae30aff0ac tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.162981 Jul 14 15:57:35.489752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 177/372] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:35.588702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:35.596674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-117aa872-025d-4a6b-a653-c24f9fce5d4c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.154792 Jul 14 15:57:35.597236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 196/373] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:35 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:35.699348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d746562b-35b6-4902-9426-073aa01be291 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: .version_select at 0x7f33ff79b670>, body: {"keypair": {"name": "tempest-keypair-145716787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdx9X1NR1bqGUvVkk6Ye4EOpWYKLTLDTjuP4W8LtOyMBoeyjXTVwqOka0ca6UZcUNYjTzx4eUWIc9+EzXwyNIHoSXorD9XY5XNt8Hxbt2qikw/JDOP9LJl5KudVrOyyBg=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:35.713945 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-d746562b-35b6-4902-9426-073aa01be291 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:35.717770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-d746562b-35b6-4902-9426-073aa01be291 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for user 81ca45714ee44a549fd002b4aa13973b and project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:35.833125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d746562b-35b6-4902-9426-073aa01be291 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137612 Jul 14 15:57:35.833738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 178/374] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:57:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:36.174242 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.174856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.181722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.182217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.182975 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.183410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.255940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.256657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.263036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.263487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.264258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.264701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.333209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.338965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.341251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-514159bb-624e-48e0-b81d-2054e5668064 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1266 microversion: 2.1 time: 0.089780 Jul 14 15:57:36.341937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 179/375] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:36.354696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2a31a8db-4b9d-4800-919a-76c9273cdff6 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.184475 Jul 14 15:57:36.355219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 197/376] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:36.414412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.415027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.421310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.421771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.422567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.422996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.505445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.506109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.512087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.512550 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.513320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.513763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.567471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.572918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.574531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.575687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-57483346-30c9-414b-a826-87f26b5c3823 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1741 microversion: 2.20 time: 0.165700 Jul 14 15:57:36.576253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 180/377] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:36.614202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:36.614741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:36.620918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.621372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.622169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:36.622616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:36.696419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.706064 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f39adb22-bbba-4522-803e-4493468ecee8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.204373 Jul 14 15:57:36.706665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 198/378] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:36.861757 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:36.871791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-652df3ca-4fc4-49e7-b345-d97ca3f62896 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.261518 Jul 14 15:57:36.872903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 181/379] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:36 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:37.359531 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.360758 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.372250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.372871 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.386590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.387396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.388369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.388967 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.392001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.392476 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.398277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.398742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.622173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:37.634160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7896e67a-f35b-4634-a5bf-80bb1f6af4a1 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1274 microversion: 2.1 time: 0.278381 Jul 14 15:57:37.635969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 199/380] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:37.641398 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.642213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.651818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.652491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.653518 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.654174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.790068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:37.798438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c1aeec11-1531-4b43-b670-8529146130be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.430111 Jul 14 15:57:37.805892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 182/381] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:37.828879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:37.832549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:37.851949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.856411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:37.857535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:37.858225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.023711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.053295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.062866 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.067996 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8f13487b-718e-4b2d-b169-f053f9a92e73 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.430576 Jul 14 15:57:38.068896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 200/382] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:38.076788 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.086195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.092993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.093659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.094879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.095478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.120660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.124844 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:38.140785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1d3ac5b6-76c5-47dc-b436-dbd318c132e0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.331731 Jul 14 15:57:38.148576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 183/383] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:37 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:38.298504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:38.308813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a51294f5-4c5a-4a1c-9d24-90457172912e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.238637 Jul 14 15:57:38.309781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 201/384] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:38.654395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.655018 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.666101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.667065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.668395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.668993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.819809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:38.826056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:38.839257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.841036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.843425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:38.846800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:38.856000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:39.038256 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.050018 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3213e917-d3f7-47e2-90cc-178522a0f3e2 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.401608 Jul 14 15:57:39.051999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 184/385] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:39.090653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.091796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.103389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.106774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.107682 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.108141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.166875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.175669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c140d57d-267a-4e07-8521-51bfb3ea9809 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.361272 Jul 14 15:57:39.176290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 202/386] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:38 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:39.181566 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.182227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.189023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.189516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.190342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.190946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.458492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.467846 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d06f9dfc-6c21-4362-b565-d64d7f521d78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.290372 Jul 14 15:57:39.471478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 203/387] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:39.479154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:39.484122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:39.543879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.543879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.543879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:39.543879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:39.703099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.712859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.714793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.716218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aca9e01a-2a1e-4be9-9b70-7c8329f032ab tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.631109 Jul 14 15:57:39.728469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 185/388] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:39.736251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1433087457", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a4b02bb-8411-4c20-b73b-d6921ecea2f8"}], "security_groups": [{"name": "tempest-securitygroup--907042912"}], "key_name": "tempest-keypair-145716787", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:39.814724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:39.829173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2fe767dd-1e67-4286-b6fe-3fb28f791ee5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.356161 Jul 14 15:57:39.838382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 204/389] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:39 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.092896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.093929 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.095967 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] validate_networks() for [('5a4b02bb-8411-4c20-b73b-d6921ecea2f8', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:40.103152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.103797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.104729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.105950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.297682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.309389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-66bc18d4-55f3-44cd-be0f-463e3173a7cb tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.244499 Jul 14 15:57:40.320152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 205/390] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.325686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.328936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.332791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:40.334530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.335214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.336053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.336589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.616286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.630761 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a7b7f7d7-67e2-43fa-b33f-a0d55ca68bd3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.308092 Jul 14 15:57:40.633061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 206/391] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.647210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-68d3e8c5-d8d2-4c08-8c6d-a47b2332265f req-0fd0117c-2932-4027-a0a6-5484079180b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985107cf-7ae3-42a1-8669-ea261e1b1c2d", "name": "network-vif-plugged", "status": "completed", "tag": "3943d8e5-7af8-4ed5-937d-4c847a3532ef"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:40.657504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-68d3e8c5-d8d2-4c08-8c6d-a47b2332265f req-0fd0117c-2932-4027-a0a6-5484079180b0 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.658741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-68d3e8c5-d8d2-4c08-8c6d-a47b2332265f req-0fd0117c-2932-4027-a0a6-5484079180b0 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.672864 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-68d3e8c5-d8d2-4c08-8c6d-a47b2332265f req-0fd0117c-2932-4027-a0a6-5484079180b0 service nova] Creating event network-vif-plugged:3943d8e5-7af8-4ed5-937d-4c847a3532ef for instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d on hv-cinder-83716 Jul 14 15:57:40.696583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-68d3e8c5-d8d2-4c08-8c6d-a47b2332265f req-0fd0117c-2932-4027-a0a6-5484079180b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053543 Jul 14 15:57:40.698283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 207/392] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:40.726588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.727378 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.745957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.746688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.747638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.748225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.898560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:40.899182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:40.899833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:40.900245 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:40.901137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:40.944889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:40.954942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.955923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0b679e83-2338-4a2f-bafa-3cbb2146698b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.255231 Jul 14 15:57:40.956742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 208/393] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:40.956978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.957963 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.958601 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.962462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:40.963248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:40.980404 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.984452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:40.984452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:40.984452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.001377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:41.002189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:41.007001 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Getting quotas for user 81ca45714ee44a549fd002b4aa13973b and project 508fd5c51f544a3db6d0b87e37750e01. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:41.020793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:41.023361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:41.241188 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c89aeb57-a13f-460d-9d65-7d33029b5f22 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.511102 Jul 14 15:57:41.250053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 186/394] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:57:41.276656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.276656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.293931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.297364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.298586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.298727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.414294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.428666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.431494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.436951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-23c4e1c6-6e5f-48c8-9f2c-8df6ccf3c680 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.473459 Jul 14 15:57:41.448292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 209/395] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:40 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:41.448292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3b5c9311-5a7c-49f9-89bc-fc7f1b0b8dae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.448292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3b5c9311-5a7c-49f9-89bc-fc7f1b0b8dae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.559057 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3b5c9311-5a7c-49f9-89bc-fc7f1b0b8dae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.568889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3b5c9311-5a7c-49f9-89bc-fc7f1b0b8dae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1245 microversion: 2.1 time: 0.125272 Jul 14 15:57:41.572109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 210/396] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:41.582404 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-e46e2300-9315-42de-8e82-3183d857c900 req-9bd1024d-fc06-4c7e-affa-3cad5f4ad40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e826a0af-1006-467e-8bf2-2fec18d15994", "tag": "608013ee-22c5-4f38-b5f1-8d4e25ca12ab"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:41.595040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-e46e2300-9315-42de-8e82-3183d857c900 req-9bd1024d-fc06-4c7e-affa-3cad5f4ad40a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.595604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-e46e2300-9315-42de-8e82-3183d857c900 req-9bd1024d-fc06-4c7e-affa-3cad5f4ad40a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.608544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-e46e2300-9315-42de-8e82-3183d857c900 req-9bd1024d-fc06-4c7e-affa-3cad5f4ad40a service nova] Creating event network-changed:608013ee-22c5-4f38-b5f1-8d4e25ca12ab for instance e826a0af-1006-467e-8bf2-2fec18d15994 on hv-cinder-83716 Jul 14 15:57:41.614390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-e46e2300-9315-42de-8e82-3183d857c900 req-9bd1024d-fc06-4c7e-affa-3cad5f4ad40a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040588 Jul 14 15:57:41.616035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 211/397] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:41.620780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.621706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.628870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.629795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.630914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.631450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.753182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.787603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-39813aa4-5ec0-4b39-b344-a120b4b88315 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.535923 Jul 14 15:57:41.788916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 187/398] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:41.816248 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.817188 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.832108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.878075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.878075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.878075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.878551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:41.889603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d6649500-3f38-4e80-9094-d64b29534466 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.273294 Jul 14 15:57:41.903387 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 212/399] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:41.975739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:41.976416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:41.986420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.986873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:41.987656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:41.988095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.103887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.111656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f22867f4-af51-42da-880d-f9960664faf4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.321431 Jul 14 15:57:42.112224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 188/400] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:42.213195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.234139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3e52e535-1e00-41d9-bdba-6603901f50bf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.257105 Jul 14 15:57:42.235184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 213/401] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:41 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:42.458464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.459306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.472766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.476600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.483313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.485120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.588517 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3333789f-9f91-49a4-afb6-ee25978812fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.589488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3333789f-9f91-49a4-afb6-ee25978812fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.601598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:42.697271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3333789f-9f91-49a4-afb6-ee25978812fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.713775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3333789f-9f91-49a4-afb6-ee25978812fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1245 microversion: 2.1 time: 0.129224 Jul 14 15:57:42.725805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 214/402] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:42.735080 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "name": "network-vif-plugged", "status": "completed", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}, {"server_uuid": "dd607e1d-a8e4-4d78-9624-ca81454a3b76", "name": "network-vif-plugged", "status": "completed", "tag": "ce7c554f-9081-45fc-b4d3-8e80e04e0129"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:42.746114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.746114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.762661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.764681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] Creating event network-vif-plugged:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:57:42.765402 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] Creating event network-vif-plugged:ce7c554f-9081-45fc-b4d3-8e80e04e0129 for instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 on hv-cinder-83716 Jul 14 15:57:42.776690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.777456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-6271a10b-10e7-4e62-b2e5-848412752d83 req-d3027469-92ec-453c-a40e-7e2622869a0a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046410 Jul 14 15:57:42.778427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.779685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-667662c3-6711-4bd1-b93e-ab179c878f85 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.327430 Jul 14 15:57:42.783918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 215/403] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:42.791022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 189/404] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:42.806176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.810311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.817724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.818202 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.818986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.819502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.914972 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:42.915592 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:42.921812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.922300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.923076 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:42.923510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:42.969095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:42.977336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-000fb25d-446e-4d13-a26b-344e2b629271 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.176062 Jul 14 15:57:42.978039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 216/405] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:43.060782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.068777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a701f414-73ea-4461-abd9-eaa77a5fb47c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.161740 Jul 14 15:57:43.069338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 190/406] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:42 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:43.131120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.131723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.138318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.138787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.139586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.140016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.250953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.251576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.260189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.260624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.262627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.265048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.304539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.337185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f71a5f63-e8f5-4f9b-9684-41b589b3b872 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1319 microversion: 2.1 time: 0.201771 Jul 14 15:57:43.337185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 217/407] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:43.542473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.555262 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-07af16f2-7e68-4f6a-9d06-6e590c771093 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.307982 Jul 14 15:57:43.556578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 191/408] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:43.730716 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.731431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.743650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.744924 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.745337 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.746081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.798517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:43.799732 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:43.815260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.815767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.816639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:43.819492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:43.852668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:43.860535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9f4c26c0-569e-4443-be00-2d3dfe373a7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1249 microversion: 2.1 time: 0.133788 Jul 14 15:57:43.871749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 218/409] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1249 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:43.999486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.001705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.009025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.011383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.012405 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.013266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.044771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.055650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.057583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.059065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0020a4f3-ea9a-4f81-ba07-bd0c2e172797 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.264436 Jul 14 15:57:44.060114 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 192/410] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:44.088093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.088973 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.098524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.099356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.104169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.106358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.190862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.199643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-118d3d55-c05b-472a-8c66-4cfec04e2823 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.208066 Jul 14 15:57:44.200234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 219/411] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:43 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.295961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.305498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f0d24552-83a1-4165-afc6-749f8703b556 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.224465 Jul 14 15:57:44.306581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 193/412] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:44.344142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.344779 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.351909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.356925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.356925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.356925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.527274 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.536838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-471710af-2fdd-4f4e-bc05-1c37d6277c71 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1508 microversion: 2.1 time: 0.195794 Jul 14 15:57:44.538011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 220/413] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.576410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.576410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.585164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.585164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.585164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.585164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.762651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:44.773732 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cd943ecc-e49a-47af-95cd-1cc04ce25381 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.204096 Jul 14 15:57:44.778720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 194/414] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:44.881773 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:44.882712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:44.891694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.893224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.894210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:44.897539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:44.978756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.000714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4f18d71f-eeaa-4943-ab78-de7c8c6e0e7e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1241 microversion: 2.1 time: 0.123744 Jul 14 15:57:45.001390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 221/415] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:44 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:45.083138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.083772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.097545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.098370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.100432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.103304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.218338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.220562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.249103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.249768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.256886 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.257999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.433402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.448653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.450306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.451637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-093d44a8-06ff-4b8e-95ab-29faba850deb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.372816 Jul 14 15:57:45.452327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 195/416] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:45.474414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.474414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.480074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.481280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.482181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.482696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.520413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.527382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:45.534471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0f3e9622-35b0-4433-b424-d6cf4aeca1f7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.320063 Jul 14 15:57:45.535285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 222/417] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:45.803981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:45.804704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:45.806511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:45.824862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4c78dccb-3985-464c-af26-5c5c2ef29305 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.360626 Jul 14 15:57:45.825480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 196/418] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:45.833620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.836978 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:45.842378 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:45.861143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.020883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.021695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.029967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.037406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.038375 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.039995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.040798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.062732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-43b9b10a-9f89-4eb7-b7da-f5ab66ec36db tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.275904 Jul 14 15:57:46.063941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 223/419] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:45 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:46.161384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.171000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f6e28ab4-3d14-4769-a316-44b2eafed3f7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1297 microversion: 2.1 time: 0.155506 Jul 14 15:57:46.171960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 197/420] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:46.476372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.477274 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.486554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.487104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.487951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.489998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.553171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.556184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.580956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.582631 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.587013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.589276 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.719257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.735618 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.740152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.741841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fe9477e6-fa73-4553-a461-04eb5d0505c2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.274604 Jul 14 15:57:46.750682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 224/421] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:46.848969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:46.849585 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:46.856459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.856909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.857686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:46.860875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:46.897550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:46.921364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0a5d3b6a-39dd-4db0-bb07-dbf2244ff148 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.372483 Jul 14 15:57:46.931029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 198/422] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:47.086106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.087045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.093983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.094531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.094931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.095896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.096489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.104480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-80060cd7-3773-4add-a7ac-ed2b38e3d03a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.263925 Jul 14 15:57:47.115256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 225/423] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:46 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:47.207982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.207982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.207982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.207982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.208878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.208878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.243315 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.258977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a9b9b804-3c39-4776-bda3-41491eb36745 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1366 microversion: 2.1 time: 0.178140 Jul 14 15:57:47.259591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 199/424] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:47.264780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:47.273239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8ea1a31f-c878-46fe-8320-84239d44dac3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1297 microversion: 2.1 time: 0.088321 Jul 14 15:57:47.273805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 226/425] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:47.778902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.781760 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.808933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.810097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.818687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.819456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.952453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:47.953140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:47.990063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.991493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:47.993153 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:47.994199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.271339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.279904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.281961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.283545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c6e1f936-0aad-4793-bcf4-26ccb75bc8eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.515788 Jul 14 15:57:48.284373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 200/426] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:48.289255 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.290214 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.296868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.297570 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.298990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.300045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.306560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:48.328847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.340280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3604ba83-0199-4552-9253-cb687965db2b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.390505 Jul 14 15:57:48.341392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 227/427] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:47 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:48.348090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.348956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.356218 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.357010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.357805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.358394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.577850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.587915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-90eac21d-29d8-40fe-9b16-230d1ec1fcd5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1555 microversion: 2.1 time: 0.245105 Jul 14 15:57:48.594634 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 228/428] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:48.610075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.610236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.611076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.621027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ecb454b3-c744-439d-b0c2-031c7124e15e tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.335355 Jul 14 15:57:48.627137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 201/429] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:48.636470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.637720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.639032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.639771 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.642497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:48.645719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:48.651318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.659242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.660579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.661032 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.755840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:48.770394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-93e47f9a-d3b9-447c-a50b-be7113d738e5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1303 microversion: 2.1 time: 0.168932 Jul 14 15:57:48.771069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 229/430] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:48.805701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-7e882614-5b24-481a-9165-5c3a8daa137e req-f44a2f31-8503-4fa2-904f-df85f5fc7ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e826a0af-1006-467e-8bf2-2fec18d15994", "name": "network-vif-plugged", "status": "completed", "tag": "608013ee-22c5-4f38-b5f1-8d4e25ca12ab"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:48.816641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7e882614-5b24-481a-9165-5c3a8daa137e req-f44a2f31-8503-4fa2-904f-df85f5fc7ecf service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:48.817767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7e882614-5b24-481a-9165-5c3a8daa137e req-f44a2f31-8503-4fa2-904f-df85f5fc7ecf service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:48.868300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-7e882614-5b24-481a-9165-5c3a8daa137e req-f44a2f31-8503-4fa2-904f-df85f5fc7ecf service nova] Creating event network-vif-plugged:608013ee-22c5-4f38-b5f1-8d4e25ca12ab for instance e826a0af-1006-467e-8bf2-2fec18d15994 on hv-cinder-83716 Jul 14 15:57:48.887898 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-7e882614-5b24-481a-9165-5c3a8daa137e req-f44a2f31-8503-4fa2-904f-df85f5fc7ecf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086730 Jul 14 15:57:48.904375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 230/431] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:49.032469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ec1417a0-4359-4cee-b9dc-12ee31ae93c1 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.403752 Jul 14 15:57:49.036632 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 202/432] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 15:57:48 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/os-interface => generated 284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:49.311926 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.312931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.329086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.330930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.332727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.333177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.358484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.359464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.374743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.375449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.376413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.382723 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.676655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.689437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0fe0a60c-cdf4-45a8-b033-5e9efdd89cd0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.335489 Jul 14 15:57:49.699673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 203/433] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:49.707875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.708817 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.716174 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.716907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.717920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.719151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.763161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.781142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.795857 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:49.801607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-16c7b4e0-4cf7-4e16-a2b9-c80b88ebca3d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.490153 Jul 14 15:57:49.802774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 231/434] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:49.818216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:49.819500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:49.827386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.828188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:49.829483 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:49.830146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.179412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.193020 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-206df2d6-65b1-408e-88e3-988deaffa53c tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.491791 Jul 14 15:57:50.193638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 204/435] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:50.642417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.651075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7ded3877-b337-433f-9266-6e49a98e3ce3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.846034 Jul 14 15:57:50.653033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 232/436] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:49 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:50.708040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:50.708961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:50.721117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.721956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.729472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.729472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.821023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:50.821809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:50.828568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.829855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.831933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:50.831933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:50.977914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:50.980712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.990857 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.992608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:50.994062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-56bb2ec8-73df-4f4d-838b-dbd2892f1a69 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.177804 Jul 14 15:57:51.004148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 233/437] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:50 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:51.015322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=10 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:51.213086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:51.213958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:51.222025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.224435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.226312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.228656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.291373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:51.309413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ee86a73a-c141-4b9d-91f3-cf8204206edb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.606197 Jul 14 15:57:51.310037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 205/438] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:50 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:51.590443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:51.625061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-08aab908-0e58-41ca-9dc4-4549b2a4254b tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1314 microversion: 2.1 time: 0.414856 Jul 14 15:57:51.625061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 234/439] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:51 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:51.673321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:51.674606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:51.682843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.683303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.684397 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.684849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.865895 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-b6a9b63c-90f6-44ac-b6b1-55472ea7eea3 req-07b60966-490e-4978-9c1e-acf19017a7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:51.882158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b6a9b63c-90f6-44ac-b6b1-55472ea7eea3 req-07b60966-490e-4978-9c1e-acf19017a7fe service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.884804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b6a9b63c-90f6-44ac-b6b1-55472ea7eea3 req-07b60966-490e-4978-9c1e-acf19017a7fe service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:51.918588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-b6a9b63c-90f6-44ac-b6b1-55472ea7eea3 req-07b60966-490e-4978-9c1e-acf19017a7fe service nova] Creating event network-changed:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 15:57:51.932791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-b6a9b63c-90f6-44ac-b6b1-55472ea7eea3 req-07b60966-490e-4978-9c1e-acf19017a7fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074651 Jul 14 15:57:51.933948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 235/440] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:57:51.944780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-97189870-2360-4d81-9347-76cb1b314094 req-1d0f9048-8442-4263-a43e-47f5d1537cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd607e1d-a8e4-4d78-9624-ca81454a3b76", "tag": "ce7c554f-9081-45fc-b4d3-8e80e04e0129"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:51.965363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-97189870-2360-4d81-9347-76cb1b314094 req-1d0f9048-8442-4263-a43e-47f5d1537cee service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:51.978592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-97189870-2360-4d81-9347-76cb1b314094 req-1d0f9048-8442-4263-a43e-47f5d1537cee service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.010710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-97189870-2360-4d81-9347-76cb1b314094 req-1d0f9048-8442-4263-a43e-47f5d1537cee service nova] Creating event network-changed:ce7c554f-9081-45fc-b4d3-8e80e04e0129 for instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 on hv-cinder-83716 Jul 14 15:57:52.028101 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-97189870-2360-4d81-9347-76cb1b314094 req-1d0f9048-8442-4263-a43e-47f5d1537cee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090727 Jul 14 15:57:52.029786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 236/441] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:52.040449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:52.041672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:52.051614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.052366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.053328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.054112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.218441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.228753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2b04e5ba-0db0-4bb5-ac4a-d25f5d2ef7a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.562598 Jul 14 15:57:52.229746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 206/442] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:51 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:52.326515 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:52.328033 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:52.338487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.343839 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.344504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.345477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.350265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.354982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.357135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.359178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3574da58-65bb-4f63-9b06-792372747e8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.327441 Jul 14 15:57:52.370633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 237/443] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:52 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:52.664319 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:52.665223 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:52.672539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.673172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.674151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:52.674744 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:52.712929 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=12 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:52.862607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.870740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:52.880231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-afaf1fd0-af8f-409a-a004-7d002fe68806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.557801 Jul 14 15:57:52.881207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-81132629-f393-416c-a0da-766c94f82690 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1497 microversion: 2.1 time: 0.218755 Jul 14 15:57:52.894099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 238/445] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:52 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:52.894526 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 207/445] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:52 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:53.260264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:53.261932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:53.286306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.287084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.302947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.303400 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.380180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:53.381100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:53.405774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.414082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.417959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.423144 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.584188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:53.602608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b5fcaa0f-4ff6-4005-9434-2f722aa75f41 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.357568 Jul 14 15:57:53.604672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 239/446] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:53 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:53.897026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:53.898577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:53.905786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.913023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.913023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:53.913023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:53.992835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.011218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.017644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.021252 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f8a713d5-0423-4b82-9df8-c652135db8bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.645032 Jul 14 15:57:54.037612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 208/447] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:53 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:54.142259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.152795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-af9d415d-9ecf-4188-b9bb-001f9bd43806 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.259497 Jul 14 15:57:54.153889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 240/448] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:53 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:54.289793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:54.290537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:54.297622 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.298365 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.299141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.299574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.328130 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:57:54.621668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:54.622486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:54.628927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.629591 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.630571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.631016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.652754 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:54.779322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.786428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-781552f4-5ce5-4775-9dc5-fafbba560621 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.168358 Jul 14 15:57:54.787339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 241/449] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:54 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:54.826175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-53bca6a1-34c0-4a0e-9d97-0311f4477f63 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 204 len: 0 microversion: 2.1 time: 0.542190 Jul 14 15:57:54.826908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 209/450] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:57:54 2022] DELETE /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:57:54.835687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:54.836471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:54.842695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.843150 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.843913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:54.844354 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:54.977360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:54.985022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e9562235-a2c0-4285-bca9-eb9055600906 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1503 microversion: 2.1 time: 0.153842 Jul 14 15:57:54.985639 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 242/451] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:54 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:55.042072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.042740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:55.048800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.049244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.050278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.050716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.170673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.171289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:55.177541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.178029 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.178798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.179253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.185803 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.194318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.195842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.196999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c9007ce1-af4e-4e41-8ba1-e73da6231da9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.159317 Jul 14 15:57:55.197753 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 210/452] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:55.311099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.319702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4fe3bed7-0e8f-454a-af5a-fccce9694eef tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.153029 Jul 14 15:57:55.320275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 243/453] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:55.804313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:55.804931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:55.807391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-858665468", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:55.812630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.813605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.815202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:55.815808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:55.859240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] validate_networks() for None {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:55.953224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:55.963020 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5a50fed6-5b51-4fa8-ba92-076630aae320 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.163242 Jul 14 15:57:55.963742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 211/454] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:56.002806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.003407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.009327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.009776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.010567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.011002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.140837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:56.141375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:56.141746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:56.142303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:56.142866 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:56.149076 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.152503 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.152939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.153727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.154193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.156577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-45330097-a7e8-4079-9cac-c5df9d7babf3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1503 microversion: 2.1 time: 0.157785 Jul 14 15:57:56.164001 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 212/455] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:55 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:56.172193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Getting quotas for project fe724e7c19ce44aeb2c84b4e3c5e9290. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:56.176530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Getting quotas for user c7d08009396541538ae8a3c63cca91f4 and project fe724e7c19ce44aeb2c84b4e3c5e9290. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:56.187502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:56.189771 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:56.219003 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.219777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.226393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.226848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.227613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.228055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.320386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3da9ba2c-6785-4263-a201-d6c84c85a4ea tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516835 Jul 14 15:57:56.325875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 244/456] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:57:56.333876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c771a555-7fb3-49dd-87c5-f30260f26859 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.335622 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c771a555-7fb3-49dd-87c5-f30260f26859 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.373359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.393467 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.396212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c771a555-7fb3-49dd-87c5-f30260f26859 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.396362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.403948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d85e620b-baf0-4d24-875f-2c81a7e8a4b5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1736 microversion: 2.20 time: 0.188625 Jul 14 15:57:56.406604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c771a555-7fb3-49dd-87c5-f30260f26859 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1214 microversion: 2.1 time: 0.079038 Jul 14 15:57:56.407424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 245/457] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:56 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:56.411821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.417429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.417429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:56.418267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 213/458] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:56 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:57:56.419972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.420487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.421322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.421845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.556959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:56.565087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d9708b59-5c0e-4efe-afa2-f9073df88077 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.156842 Jul 14 15:57:56.565668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 246/459] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:56 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:56.980672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:56.981389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:56.988027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.988485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:56.989270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:56.989714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.175384 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:57.176233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:57.183176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.183636 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.184409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.184853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.241413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.252490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3aa38e5b-8715-4f35-b3e9-315f423de97f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.275823 Jul 14 15:57:57.253705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 214/460] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:56 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:57.330016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.338225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c9fc3699-ac18-487c-98c2-4a7b42bc071f tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1503 microversion: 2.1 time: 0.167426 Jul 14 15:57:57.338799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 247/461] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:57 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:57.422806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:57.423416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:57.432490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3634fe80-414c-401a-b70d-16a86681253b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:57.433097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3634fe80-414c-401a-b70d-16a86681253b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:57.434470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.434970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.435751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.436191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.485496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3634fe80-414c-401a-b70d-16a86681253b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.493121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3634fe80-414c-401a-b70d-16a86681253b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1214 microversion: 2.1 time: 0.064429 Jul 14 15:57:57.493736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 248/462] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:57 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:57.582668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:57.583283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:57.589568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.590071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.590850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.597114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.656502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.665435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.667227 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.669493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-77b83672-24d8-470b-8524-6f4564e7ec9d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1718 microversion: 2.20 time: 0.249496 Jul 14 15:57:57.669493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 215/463] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:57 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1718 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:57.673626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-511956db-ada3-411d-b378-7bc8fe21482c req-f03717f7-cfb5-4e1f-bf34-6c5851f5ed1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e826a0af-1006-467e-8bf2-2fec18d15994", "name": "network-vif-deleted", "tag": "608013ee-22c5-4f38-b5f1-8d4e25ca12ab"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:57.684578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-511956db-ada3-411d-b378-7bc8fe21482c req-f03717f7-cfb5-4e1f-bf34-6c5851f5ed1a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:57.685217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-511956db-ada3-411d-b378-7bc8fe21482c req-f03717f7-cfb5-4e1f-bf34-6c5851f5ed1a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:57.698288 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-511956db-ada3-411d-b378-7bc8fe21482c req-f03717f7-cfb5-4e1f-bf34-6c5851f5ed1a service nova] Creating event network-vif-deleted:608013ee-22c5-4f38-b5f1-8d4e25ca12ab for instance e826a0af-1006-467e-8bf2-2fec18d15994 on hv-cinder-83716 Jul 14 15:57:57.703597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-511956db-ada3-411d-b378-7bc8fe21482c req-f03717f7-cfb5-4e1f-bf34-6c5851f5ed1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Jul 14 15:57:57.704194 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 216/464] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:57.733326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:57.746285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c3ca930b-ca43-4515-9907-8bce9e6eb1b4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.163345 Jul 14 15:57:57.746285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 249/465] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:57 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:58.272035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.272751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:58.279111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.279559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.280319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.280763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.284841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:58.355668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.356213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:58.364037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.373793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.373793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.373793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.419921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.428850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c158bd70-07cf-4fd6-877a-db862e19311e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.161880 Jul 14 15:57:58.429437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 217/466] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:58.449901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.457951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9440f167-37df-4f94-83af-3481a793a1a7 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1461 microversion: 2.1 time: 0.106070 Jul 14 15:57:58.458934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 250/467] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:58.512054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.512781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:58.520451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.521053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.521884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.522330 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.625619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.639449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ab94ded2-06e1-4f68-bdb1-e509ba45ee65 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1218 microversion: 2.1 time: 0.126750 Jul 14 15:57:58.650151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 218/468] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:58.689071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.689725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:58.696231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.696685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.697465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.697958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.760740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:58.762729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:58.776946 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.777413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.778374 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:58.779527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:58.848201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.858695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.860693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:58.861894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-96de7a83-f236-4554-a23a-c9c2907149bf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1718 microversion: 2.20 time: 0.177583 Jul 14 15:57:58.870332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 251/469] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:57:59.008333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:59.016718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f2fd9096-4982-476d-9089-1ee01d7cf1f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1724 microversion: 2.1 time: 0.261409 Jul 14 15:57:59.017288 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 219/470] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:58 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:59.447787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:59.448417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:59.454955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.455414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.456185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.456627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.476435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:59.476435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:59.482618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.483265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.484034 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.484521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.516343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.516902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.517481 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lazy-loading 'fault' on Instance uuid e826a0af-1006-467e-8bf2-2fec18d15994 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:57:59.565971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84d1283721f408d85c0b835d9173daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf005aaa274e98a3f098e45105c0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:59.573957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-13dad2be-0f98-4e6a-bda5-96ff673e3d8a tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 200 len: 1304 microversion: 2.1 time: 0.102388 Jul 14 15:57:59.574525 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 220/471] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:59 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:57:59.590807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:59.599011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-18b8d585-90c7-4b00-9c01-2b8b97f1fbd2 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.155082 Jul 14 15:57:59.599626 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 252/472] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:59 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:59.657712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:59.658350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:59.664440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.664890 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.665654 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.666111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.729212 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:59.736511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fd365f84-09cd-4263-967f-b210fefa676c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1266 microversion: 2.1 time: 0.082709 Jul 14 15:57:59.737055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 221/473] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:59 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:59.881563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:59.882237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:59.888333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.888784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:59.889542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:59.890018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.024957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.033611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.034336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.035813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.036063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.037617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a8fa9021-f5dc-4f3b-a642-b8844c7ffcd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1718 microversion: 2.20 time: 0.159445 Jul 14 15:58:00.038226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 253/474] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:57:59 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:00.047880 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.048345 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.049143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.049587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.182401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.190405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4b7c5a55-5ddb-49ab-a7ed-185c780ed018 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1701 microversion: 2.1 time: 0.159925 Jul 14 15:58:00.190982 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 222/475] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:00.208613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b95fb79f-4809-48c1-8474-b153d169f529 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:00.215087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b95fb79f-4809-48c1-8474-b153d169f529 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.215530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b95fb79f-4809-48c1-8474-b153d169f529 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.237971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b95fb79f-4809-48c1-8474-b153d169f529 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Going to try to start instance {{(pid=129992) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:58:00.446938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b95fb79f-4809-48c1-8474-b153d169f529 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action" status: 202 len: 0 microversion: 2.1 time: 0.242762 Jul 14 15:58:00.447785 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 254/476] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:58:00 2022] POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:58:00.455968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.456614 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.463680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.464329 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.465485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.466065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.592849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.593854 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] [instance: e826a0af-1006-467e-8bf2-2fec18d15994] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.601791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.602273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.603050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.603637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.621467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] HTTP exception thrown: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Request method failure captured: Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 HTTP/1.1 Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DzEI_6YQUir2ng43q__V-dDzEYAMpfJ7VwfjGxJXBGOKJHa_2l0qxjxZMfm7dFzVUOmOg8TQDeJxNaNKnE4BqHlYUGq16LekKpco2Ov6ZkWU2Q4i9m-3gjhCap9LBVii7vZ0P3Hl7k3G8CHedL62bNupSf6yML0S7zMCwqbZ5UdB-Q Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 8edf005aaa274e98a3f098e45105c0da Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesActionsTest-1824099171 Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:58:00.623192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8edf005aaa274e98a3f098e45105c0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8edf005aaa274e98a3f098e45105c0da", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8edf005aaa274e98a3f098e45105c0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8edf005aaa274e98a3f098e45105c0da"}]}] Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesActionsTest-1824099171 Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 8edf005aaa274e98a3f098e45105c0da Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesActionsTest-1824099171 Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesActionsTest-1824099171-project Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: a84d1283721f408d85c0b835d9173daf Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesActionsTest-1824099171-project Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. Jul 14 15:58:00.624575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'e826a0af-1006-467e-8bf2-2fec18d15994'} Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:00.625445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. Jul 14 15:58:00.628142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:58:00.631148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] Returning 404 to user: Instance e826a0af-1006-467e-8bf2-2fec18d15994 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:00.631148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a749f6a0-9de1-4e1e-8893-b539d249c4a3 tempest-VolumesActionsTest-1824099171 tempest-VolumesActionsTest-1824099171-project] 10.222.0.47 "GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994" status: 404 len: 111 microversion: 2.1 time: 0.036527 Jul 14 15:58:00.631148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 255/477] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/e826a0af-1006-467e-8bf2-2fec18d15994 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:00.634864 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.641557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.651679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.652767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.653683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.654251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.806904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.814930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-06998905-3193-4dab-9b24-8b464596db99 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.188381 Jul 14 15:58:00.817180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 256/478] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:00.822423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-0bd8f52c-b54c-4f26-b340-aa306929dfb2 req-f08ca82e-da30-47d8-9e19-88def4d9ead1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "name": "network-vif-plugged", "status": "completed", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:00.831039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-0bd8f52c-b54c-4f26-b340-aa306929dfb2 req-f08ca82e-da30-47d8-9e19-88def4d9ead1 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.832092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-0bd8f52c-b54c-4f26-b340-aa306929dfb2 req-f08ca82e-da30-47d8-9e19-88def4d9ead1 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.853283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-0bd8f52c-b54c-4f26-b340-aa306929dfb2 req-f08ca82e-da30-47d8-9e19-88def4d9ead1 service nova] Creating event network-vif-plugged:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 15:58:00.858450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-0bd8f52c-b54c-4f26-b340-aa306929dfb2 req-f08ca82e-da30-47d8-9e19-88def4d9ead1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040052 Jul 14 15:58:00.859660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 257/479] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:00.865554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:00.869002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:00.873851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.874495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.875440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:00.876027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:00.882981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.892927 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b18548ef-c230-4f2e-bde9-03036a52f956 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.440837 Jul 14 15:58:00.903205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 223/480] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:00.951512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:00.962651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-019de04c-49ac-4f11-bcda-6b2c4142200b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1274 microversion: 2.1 time: 0.098606 Jul 14 15:58:00.962651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 258/481] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:00 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:01.057600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:01.058009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:01.064242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.064772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.065633 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.066169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.195739 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:01.204241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:01.205759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:01.207140 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-22b5b5b5-3ad0-431c-933b-06bd2920855f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1718 microversion: 2.20 time: 0.154030 Jul 14 15:58:01.207773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 224/482] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:01 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:01.832990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:01.833610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:01.841801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.842294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.843076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.843556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.911504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:01.912119 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:01.924298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.924755 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:01.926394 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:01.937613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.000021 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.008876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a83cfc4f-7a8e-45c6-89d9-083c64d30035 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.180164 Jul 14 15:58:02.010391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 259/483] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:01 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:02.016770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:02.017585 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:02.024546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.025278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.026268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.027074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.134009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.143629 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-def32a78-5cd7-49d4-8aa2-8205c1bf3c4a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1274 microversion: 2.1 time: 0.130487 Jul 14 15:58:02.147113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 260/484] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:02 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:02.225438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:02.226088 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:02.232379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.232836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.233606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.234090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.238290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:02.382132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.391432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.393006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.394094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a8327ab7-543b-4d9c-b66c-6c9fe02a4c0d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1718 microversion: 2.20 time: 0.173253 Jul 14 15:58:02.394983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 261/485] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:02 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:58:02.570277 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:02.578372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a8e7d68d-09e1-4cbd-a45d-f72477164897 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.672878 Jul 14 15:58:02.580046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 225/486] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:01 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:02.891838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-52b4e80a-6dfd-40c5-b797-6eb120bca6d2 req-0f557541-fc31-4982-9704-b906d47b9113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "name": "network-vif-unplugged", "status": "completed", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:02.901457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-52b4e80a-6dfd-40c5-b797-6eb120bca6d2 req-0f557541-fc31-4982-9704-b906d47b9113 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:02.901920 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-52b4e80a-6dfd-40c5-b797-6eb120bca6d2 req-0f557541-fc31-4982-9704-b906d47b9113 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:02.914810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-52b4e80a-6dfd-40c5-b797-6eb120bca6d2 req-0f557541-fc31-4982-9704-b906d47b9113 service nova] Creating event network-vif-unplugged:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:58:02.919575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-52b4e80a-6dfd-40c5-b797-6eb120bca6d2 req-0f557541-fc31-4982-9704-b906d47b9113 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031591 Jul 14 15:58:02.925951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 262/487] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:03.026347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.026928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.034765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.036049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.037000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.037588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.164205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.165165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.172159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.172608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.173558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.173977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.234869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.237694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.245186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8b417255-8681-487f-bcd6-5f4cd74bec64 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.222779 Jul 14 15:58:03.246203 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 226/488] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:03.246408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b57d37a2-a232-47ff-be10-85f23a7c5336 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1272 microversion: 2.1 time: 0.086507 Jul 14 15:58:03.246977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 263/489] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:03.412669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.413363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.419296 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.419744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.420498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.420930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.597013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.597568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.606079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.606786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.607574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.608017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.651310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.660557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.662136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.663505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a2143a3c-5a34-4fa9-a590-9de709b5bcd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1721 microversion: 2.20 time: 0.254772 Jul 14 15:58:03.664072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 227/490] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:03.682452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63d9dcab-d343-4802-b270-629031a044e8"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:03.683622 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.685707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:03.690931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.692182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.693418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.693882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.753248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.762583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d0be9333-5571-4128-8a51-cf5dd12565d6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.170710 Jul 14 15:58:03.763253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 264/491] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:04.263209 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.263908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.271546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.275712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.275712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.275712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.400129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:04.407726 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c6283a5b-0b9f-4a36-8fa6-b270188685a6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.148212 Jul 14 15:58:04.408481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 265/492] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:04 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:04.413847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.414775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.421521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.421999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.422814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.423248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.553956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:04.560342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d8eebd33-ee03-4cca-9235-68887fea8b53 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.150690 Jul 14 15:58:04.560913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 266/493] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:04 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:04.701368 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9588b307-3ef6-4a6c-8170-87f529e10fa8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.023089 Jul 14 15:58:04.701933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 228/494] 10.222.0.47 () {62 vars in 1363 bytes} [Thu Jul 14 15:58:03 2022] POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 188 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:58:04.779702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.780309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.786811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.787243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.787990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.788416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.821482 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:04.822187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.828964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.829425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.830239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.830693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.917883 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:04.926949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-02b7f964-8f51-4b39-ae5c-8a08a3ae4c6a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.151197 Jul 14 15:58:04.927525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 267/495] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:04 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:05.060628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:05.153079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-42f7140d-150c-4f74-a28a-b00a4f7e8516 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/action" status: 202 len: 0 microversion: 2.20 time: 0.335511 Jul 14 15:58:05.154040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 229/496] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 14 15:58:04 2022] POST /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:58:05.162921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:05.164255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.169670 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.170198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.170966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.171403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.306776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.315066 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.316604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.317753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0c7efa26-c04f-47c9-88d0-e1bf26f4b4e1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1807 microversion: 2.20 time: 0.159662 Jul 14 15:58:05.318547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 268/497] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:05 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:05.424370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:05.425243 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.432195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.432647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.433411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.433860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.563183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.571256 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-88279630-45e8-4493-880e-051b2b5aca90 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.150738 Jul 14 15:58:05.571977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 230/498] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:05 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:05.578158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:05.579148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.588776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.588776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.588776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.588776 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.719761 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:05.728526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1c2ae704-ec5b-4938-8050-23be9ac2f5ad tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.154618 Jul 14 15:58:05.729103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 269/499] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:05 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:05.944314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:05.945073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:05.951774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.952342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:05.953222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:05.953899 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.128649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.137848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2861c3a8-4614-421a-9151-76458cdfbd1b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.198073 Jul 14 15:58:06.138429 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 231/500] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:05 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:06.336121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:06.336742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:06.338742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:06.343899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.344350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.345135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.345571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.488812 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.498746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.500297 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.501558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7d3caeec-a88c-4ef2-8e7b-3ee8079f015c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1807 microversion: 2.20 time: 0.169370 Jul 14 15:58:06.502617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 270/501] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:06 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:06.592220 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:06.598269 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:06.602370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.602932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.604000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.604543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.744742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:06.745351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:06.751356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.751796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.752565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:06.753007 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:06.883212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.890912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2e78f8ff-50d5-4ad0-9db0-35829ea57cb2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.150014 Jul 14 15:58:06.891610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 271/502] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:06 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:06.907068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:06.914679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d8091a2e-d450-4d6a-b84d-626d44848adc tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.329798 Jul 14 15:58:06.915357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 232/503] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:06 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:07.155077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.155721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.161767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.162253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.163545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.163545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.315474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.337291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-88dc8808-f374-4662-8fe6-bcb3e3d7b57b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.186130 Jul 14 15:58:07.347106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 272/504] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:07.521356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.522540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.530813 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.531741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.532582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.533303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.548181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-b92b6376-22d8-4d14-9666-dd51365102e6 req-855bfcdd-7d80-4695-807a-31efb956b985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c09c057-7b17-46ce-a09b-3c56bbe6836a", "tag": "7d27a714-3444-43c4-8310-d4f198a8bda7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:07.557322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=10 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:07.569243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b92b6376-22d8-4d14-9666-dd51365102e6 req-855bfcdd-7d80-4695-807a-31efb956b985 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.569736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b92b6376-22d8-4d14-9666-dd51365102e6 req-855bfcdd-7d80-4695-807a-31efb956b985 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.587789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-b92b6376-22d8-4d14-9666-dd51365102e6 req-855bfcdd-7d80-4695-807a-31efb956b985 service nova] Creating event network-changed:7d27a714-3444-43c4-8310-d4f198a8bda7 for instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a on hv-cinder-83716 Jul 14 15:58:07.592981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-b92b6376-22d8-4d14-9666-dd51365102e6 req-855bfcdd-7d80-4695-807a-31efb956b985 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051491 Jul 14 15:58:07.595348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 273/505] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:07.909254 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.910658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.917969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.918693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.919501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.919936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.951846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.961353 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.963224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:07.964407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fff9ae59-81ef-4f80-8226-ef7a1901f23a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1807 microversion: 2.20 time: 0.447996 Jul 14 15:58:07.965347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 233/506] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1807 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:07.969921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:07.970576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:07.977083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.977544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:07.978354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:07.978801 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.073033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:08.080735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-43d67134-d564-4f1e-8804-44635ecad852 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.175758 Jul 14 15:58:08.081328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 274/507] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:08.294617 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:08.303736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7ea7eac2-4503-4f86-a506-45eb5bbc58f5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1370 microversion: 2.1 time: 0.337261 Jul 14 15:58:08.304810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 234/508] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:07 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:08.355171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:08.356176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:08.369315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.371155 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.374016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.374830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.440246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d631364c-986f-43fe-9741-d87cb51f5bc1", "device": "/dev/sdb"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:08.442026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:08.448587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.449065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.449870 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.450306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.532832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:08.543098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2f317b30-6277-4ba1-b1bb-2699d7281dd2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.193206 Jul 14 15:58:08.556302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 275/509] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:08 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:08.985921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:08.986986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:08.994806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.995367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:08.996565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:08.997212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.164892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.176906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.178645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.180293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d5d14b0e-0e5d-4aae-a3a4-d4b70db52d82 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1747 microversion: 2.20 time: 0.199544 Jul 14 15:58:09.180859 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 276/510] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:08 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1747 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:09.185552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:09.188326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:09.193973 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.194510 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.195367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.195881 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.406391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.427526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fa23fb97-3935-4fb7-9c72-b86927d3e41d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.245584 Jul 14 15:58:09.438724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 277/511] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:09 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:09.438724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:09.439229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:09.450209 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.450653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.451714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.452736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.638447 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.646865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-35a8142d-65fc-41c0-aef8-8241cd4120c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1565 microversion: 2.1 time: 0.217748 Jul 14 15:58:09.647442 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 278/512] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:09 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:09.651931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:09.652535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:09.659618 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.660313 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.661312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.661731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.666166 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:09.828698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:09.841048 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-77fc12ca-0cad-437d-ac96-64ec9cc43aa6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1710 microversion: 2.1 time: 0.192449 Jul 14 15:58:09.842263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 279/513] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:09 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:09.848940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:09.849655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:09.857054 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.857520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.858711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:09.859466 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:09.983976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3307b059-2965-41c2-8c6e-287507631e2f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140004 Jul 14 15:58:09.984583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 280/514] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 15:58:09 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:10.021807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0d622c3c-51eb-49d9-bc54-1dadfe1118ad tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "POST /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.585513 Jul 14 15:58:10.025544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 235/515] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:58:08 2022] POST /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d/os-volume_attachments => generated 194 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:58:10.200615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:10.201871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:10.211330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.215909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.216903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.217345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.449372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:10.451184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:10.459505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.460215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.461222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.461873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.710910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.721499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-77ffe517-0541-4138-b1b3-351d93187c13 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.278339 Jul 14 15:58:10.721697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.731924 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.734323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:10.736187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 236/516] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:10 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:10.737389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d156ba26-ba72-44c8-b37f-ddc35892e46a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1749 microversion: 2.20 time: 0.541846 Jul 14 15:58:10.740208 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 281/517] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:10 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1749 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:10.867139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:10.867465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:10.889965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.890542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:10.891478 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:10.892038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.127348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.140039 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c4cc4b8e-46e4-4548-8931-130a2e090698 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1714 microversion: 2.1 time: 0.280806 Jul 14 15:58:11.144077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 237/518] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:10 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1714 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:11.744660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:11.745520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:11.758530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:11.759150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:11.762965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.763449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.764267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.764708 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.771247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.774618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.774618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:11.774618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:11.937296 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.947794 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.949959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:11.951535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-88a40961-9f82-40d8-8787-5809209af659 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1749 microversion: 2.20 time: 0.197809 Jul 14 15:58:11.952658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 238/519] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:11 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:58:12.082657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:12.094519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3caa1252-48fc-496e-95d0-b36bacf9259e tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.354076 Jul 14 15:58:12.098783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 282/520] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:11 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:12.101704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-9f170368-57fd-416a-9f2b-f09fc4d939e6 req-6bc2b73e-034a-45ba-8968-20e4fbb8fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:12.111143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-9f170368-57fd-416a-9f2b-f09fc4d939e6 req-6bc2b73e-034a-45ba-8968-20e4fbb8fb78 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.111834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-9f170368-57fd-416a-9f2b-f09fc4d939e6 req-6bc2b73e-034a-45ba-8968-20e4fbb8fb78 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.124359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-9f170368-57fd-416a-9f2b-f09fc4d939e6 req-6bc2b73e-034a-45ba-8968-20e4fbb8fb78 service nova] Creating event network-changed:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 15:58:12.130382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-9f170368-57fd-416a-9f2b-f09fc4d939e6 req-6bc2b73e-034a-45ba-8968-20e4fbb8fb78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033384 Jul 14 15:58:12.131912 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 239/521] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:58:12.970677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:12.971435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:12.984238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.984893 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:12.986336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:12.986940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.118851 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:13.119841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:13.139121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.140257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.147096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:13.147096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.170184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:13.182755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:13.189229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:13.191699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4f796bbf-6d09-40a2-b4f9-5cba42834f8c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1749 microversion: 2.20 time: 0.224243 Jul 14 15:58:13.192513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 283/522] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:12 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1749 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:13.334668 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:13.343122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-489fbddc-73a2-425f-9adc-4ba4850962db tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.230212 Jul 14 15:58:13.343643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 240/523] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:13 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:14.211819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:14.213128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:14.220575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.221061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.222053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.223113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.362349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:14.363552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.364005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:14.372716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.372938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.373717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.374539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.374663 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:14.375722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cd497c25-5fbb-4015-99b1-bb0069a53b1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.169332 Jul 14 15:58:14.376275 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:14.376834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 284/524] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:14 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:14.715650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:14.725518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-386d0d9f-ed84-4318-9ec6-4e4b7cc007d0 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.368621 Jul 14 15:58:14.726151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 241/525] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:14 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:15.394875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:15.395470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:15.402014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.402456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.403210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.403641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.543645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.552684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.554238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.555411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-04c781d0-d939-4d7c-8c45-55ceadf1172a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.164496 Jul 14 15:58:15.565923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 285/526] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:15 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:15.743376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:15.745072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:15.753834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.754820 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.756347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:15.757494 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:15.950453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:15.962235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-22b702a4-49ee-4331-8a34-f5534950c1fc tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.223453 Jul 14 15:58:15.966430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 242/527] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:15 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:16.580890 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.587793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.609200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.613620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.613620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.613620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.946514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.961040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.970865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.973707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8fdf3815-9d72-404a-a039-e78237058632 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.400295 Jul 14 15:58:16.982798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.984128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.984363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 286/528] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:16.992191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.992987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.994022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.994705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.228461 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:17.236750 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-809c8e6b-b5fe-472a-9ee7-b1616505ac00 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.257957 Jul 14 15:58:17.242716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 243/529] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:17.993197 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:17.994599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:18.001608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.007315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.007315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.007315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.215887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.233501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.235068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.236257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f4aea8fd-2cae-42b8-8504-49d129d8ff4b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.247157 Jul 14 15:58:18.236825 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 287/530] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:17 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:18.257443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:18.258096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:18.265986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.266533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.267387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:18.267955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:18.432372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:18.440763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3420fb47-b93b-4de7-b9ab-297ce26bad37 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.190573 Jul 14 15:58:18.441675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 244/531] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:18 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:19.047258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-169400fe-dd85-445d-931f-48f3e94c2186 req-8ac795ee-838a-4992-b04e-4feefffc4a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c09c057-7b17-46ce-a09b-3c56bbe6836a", "name": "network-vif-plugged", "status": "completed", "tag": "7d27a714-3444-43c4-8310-d4f198a8bda7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:19.060036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-169400fe-dd85-445d-931f-48f3e94c2186 req-8ac795ee-838a-4992-b04e-4feefffc4a14 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.061463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-169400fe-dd85-445d-931f-48f3e94c2186 req-8ac795ee-838a-4992-b04e-4feefffc4a14 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.076338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-169400fe-dd85-445d-931f-48f3e94c2186 req-8ac795ee-838a-4992-b04e-4feefffc4a14 service nova] Creating event network-vif-plugged:7d27a714-3444-43c4-8310-d4f198a8bda7 for instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a on hv-cinder-83716 Jul 14 15:58:19.083356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-169400fe-dd85-445d-931f-48f3e94c2186 req-8ac795ee-838a-4992-b04e-4feefffc4a14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039664 Jul 14 15:58:19.088221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 288/532] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:19.259508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:19.260248 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:19.269167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.270354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.271460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.272252 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.459656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:19.460388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:19.469710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.470204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.474806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:19.475501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:19.561147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.580446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:19.603766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.605857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.610435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0b7a129d-2b39-4a62-baca-947bebfc1983 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.356879 Jul 14 15:58:19.646580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 245/533] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:19 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:19.702879 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:19.715115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-12edd042-6f39-4627-b1e9-52703a53627d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.259713 Jul 14 15:58:19.726344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 289/534] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:19 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:20.650740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:20.652063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:20.659495 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.666017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.666017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.666017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.735268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:20.736359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:20.746563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.747443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.749392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:20.750760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:20.877407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:20.892208 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:20.894677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:20.897193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7dcdeda4-c539-479e-b85a-e5ee12e3c1ea tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.250016 Jul 14 15:58:20.914100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 246/535] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:20 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:21.117891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:21.117891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a80c26ea-0af1-4975-a73a-71750b9184ee tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.373357 Jul 14 15:58:21.117891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 290/536] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:20 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:21.919806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:21.920502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:21.928465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.928917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:21.929770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:21.930237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.146237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.155957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:22.156557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:22.179090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.180190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.180728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.181791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:22.182580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:22.182771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.184054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c1b0a9b6-0090-4dc1-a491-70fe510ecf8e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.268346 Jul 14 15:58:22.184971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 247/537] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:21 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:22.367643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:22.383226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3dc85411-1bd6-48bb-a0d5-d5303733d616 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.251632 Jul 14 15:58:22.385455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 291/538] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:22 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:23.206082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:23.207290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:23.230009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.230718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.231751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.232426 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.395638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.405161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.405396 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:23.405947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:23.406777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.407962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-21a7d077-c946-4106-8b8b-b04da0d76197 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.205973 Jul 14 15:58:23.408514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 248/539] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:23 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:58:23.414802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.415663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.419749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:23.420262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:23.575758 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:23.585781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-983a209b-59c7-44f3-a8d9-e18e742dc245 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.184363 Jul 14 15:58:23.595448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 292/540] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:23 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:24.426516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:24.427261 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:24.434473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.434921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.435735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.436209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.605143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:24.606453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:24.631947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.632516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.633539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:24.634202 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:24.689587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.715404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.720012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.724138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a90e4cce-6bdd-4b08-b11e-90d01ff76841 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.301692 Jul 14 15:58:24.727418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 249/541] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:24 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:24.949343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:24.949343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d753cb92-2458-4b1a-ac81-3efe9822fa57 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.342053 Jul 14 15:58:24.950521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 293/542] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:24 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:25.747971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:25.748783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:25.759829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:25.760586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:25.761369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:25.761810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:25.967113 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:25.979339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:25.981365 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:25.983797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-40b0f423-6db3-4248-8992-780ab56fd6d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.240172 Jul 14 15:58:25.985972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:25.990355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:25.996179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 250/543] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:25 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:26.019392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.020124 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.021132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:26.022683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:26.233192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:26.241780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3752ac38-2520-4e85-9e36-5729927bf8f2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.265979 Jul 14 15:58:26.251281 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 294/544] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:25 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:27.003579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:27.004874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:27.012339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.013090 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.014135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.014835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.185944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.195161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.196684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.197988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-811c980f-3c7a-4c5f-aad7-67dd14a7dbbb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.198648 Jul 14 15:58:27.198561 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 251/545] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:26 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:27.258937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:27.259512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:27.262011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:27.267161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.267620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.268388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:27.268821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:27.406548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:27.414854 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-56aed823-a137-4127-82ce-1e9de200b16c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.159880 Jul 14 15:58:27.420393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 295/546] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:27 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:28.216485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.217109 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.224128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.225558 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.227089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.227831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.374254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.383701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.385351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.386510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bb113042-0195-468b-bfc5-2f09bd7ed435 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.174015 Jul 14 15:58:28.387081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 252/547] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:28 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:28.432459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:28.433119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:28.440175 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.440755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.442414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:28.442938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:28.582525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:28.591805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:28.591805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4f199c21-7cb8-4201-834e-3e06573cff05 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.162405 Jul 14 15:58:28.591805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 296/548] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:28 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:29.405657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:29.406308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:29.413597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.414094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.414868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.415300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.550666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.559337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.560856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.562041 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cdfba7f5-c5c8-4871-9d85-df7b8ea7232c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.160868 Jul 14 15:58:29.562613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 253/549] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:29 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:29.608654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:29.609265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:29.615810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.616260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.617063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:29.617502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:29.752968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:29.768474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4dc4afd9-7c14-4ba5-9b13-e887739e3a22 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.164071 Jul 14 15:58:29.769234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 297/550] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:29 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:30.580437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:30.581159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:30.588196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.588646 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.589408 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.589860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.750530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.759466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.760976 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.762175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-31200bf6-4107-4c13-b5ff-bce855b1d24b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.185598 Jul 14 15:58:30.762736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 254/551] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:30 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:30.787540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:30.792499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:30.794814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.795386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.796348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:30.796781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:30.936231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:30.944623 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b41a0749-774b-488a-b81a-01e8c77bf1c4 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.161886 Jul 14 15:58:30.945194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 298/552] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:30 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:31.780520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:31.781322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:31.788061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.788517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.789288 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.789729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.940304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:31.949572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:31.951176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:31.952459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2e03ca3f-fd58-4f22-b876-2c1e8d7edc1b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.175926 Jul 14 15:58:31.953023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 255/553] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:31 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:31.961392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:31.962405 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:31.970086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.971177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:31.973880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:31.974343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:32.129702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:32.142440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ff602377-aad1-425b-9ee7-182daf0f620a tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.184342 Jul 14 15:58:32.143253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 299/554] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:31 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:32.974722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:32.975336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:32.982612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:32.983614 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:32.983835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:32.984273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.165743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.165947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:33.166539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:33.173595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.174071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.178769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.179013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:33.179013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:33.179178 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.179178 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ffed8b2c-84aa-4609-b9ff-45ce3f26896e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.207302 Jul 14 15:58:33.179178 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 256/555] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:32 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:33.338093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:33.349559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7f81f834-4fa3-47c8-afe0-6bc0b9a7e9b2 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.187516 Jul 14 15:58:33.350336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 300/556] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:33 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:34.195566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:34.196185 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:34.198546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=60 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:34.213066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.216904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.216904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.216904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.355941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:34.364497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:34.366103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:34.367524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b0a55fcb-b069-45c1-8c3d-c4f2a995a7cc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.176066 Jul 14 15:58:34.368291 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 257/557] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:34 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:34.382381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:34.382381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:34.382381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.382381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.383085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:34.383085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:34.524549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:34.532257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-df6dbc81-8b5d-4c33-b5ba-80ec366a2127 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1314 microversion: 2.1 time: 0.167200 Jul 14 15:58:34.532697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 301/558] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:34 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:35.386806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:35.387414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:35.394067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.394521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.395837 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.397717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.530987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.540126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.541634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.542925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5d7ae096-9195-4801-a361-96fb719d61f4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.160072 Jul 14 15:58:35.543498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 258/559] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:35 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:35.548689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:35.549296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:35.556505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.556969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.557782 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.558273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.702106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:35.710679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-30ca7fe7-2277-4520-b34d-6f3beb71cff8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1464 microversion: 2.1 time: 0.165884 Jul 14 15:58:35.711248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 302/560] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:35 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:35.750825 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:35.751331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:35.757910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.758357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.759116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:35.759549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:35.789371 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:58:36.185369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c28df31b-82a0-4fbf-8ae7-0d244ef66a32 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 204 len: 0 microversion: 2.1 time: 0.438279 Jul 14 15:58:36.185996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 259/561] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:58:35 2022] DELETE /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:58:36.199492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:36.200106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:36.206196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.206656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.207438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.207884 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.340487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:36.348573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b0ee911f-b91e-4da6-990b-4057724e03a7 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.153001 Jul 14 15:58:36.349166 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 303/562] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:36 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:36.561353 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:36.562470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:36.569786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.570143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.570918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:36.571360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:36.703612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:36.707153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:36.713136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:36.714700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:36.715864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-470f50b3-ca7f-4bd4-bcba-f10239725250 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.158976 Jul 14 15:58:36.716433 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 260/563] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:36 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:37.366425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:37.366945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:37.373485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.373972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.374737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.375198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.505056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:37.513732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7271752a-a657-426d-afea-b7267ee76d9d tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.151235 Jul 14 15:58:37.514526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 304/564] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:37 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:37.735400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:37.736009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:37.743018 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.746356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.746356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:37.746356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:37.875767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:37.884690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:37.886235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:37.887405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cd930c9b-fee1-4b14-a5f0-63543ab146b0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.156324 Jul 14 15:58:37.887965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 261/565] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:37 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:38.531858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:38.532497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:38.539870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.540255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:38.541028 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.541484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:38.679237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:38.687428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c439f287-81e8-461c-9839-561431c7bbbb tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.159341 Jul 14 15:58:38.688017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 305/566] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:38 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:38.906180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:38.937658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:38.937658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.937658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:38.937658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:38.938101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:39.054748 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:39.063776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:39.065409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:39.066624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-207a3798-b12e-4060-a355-137537b5c497 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.164814 Jul 14 15:58:39.067280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 262/567] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:38 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:39.706398 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:39.707152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:39.713565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:39.714045 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:39.714808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:39.715340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:39.861286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:39.869592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-df0e167f-ad9c-472c-8831-51c4c99c55fe tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.167289 Jul 14 15:58:39.879096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 306/568] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:39 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:40.087628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:40.088247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:40.095026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.095514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.096273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.096862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.240715 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:40.248798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:40.250509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:40.252101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5e97862e-8149-43bf-9056-3f6e0a6102fc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.169288 Jul 14 15:58:40.253122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-33f4968a-5058-4c56-b637-1f8cee3cbbf5 req-a37023bf-ee5a-405a-adbe-e171cc9c9b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "name": "network-vif-plugged", "status": "completed", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:40.253929 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 263/569] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:40 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:40.263804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-33f4968a-5058-4c56-b637-1f8cee3cbbf5 req-a37023bf-ee5a-405a-adbe-e171cc9c9b94 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.264253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-33f4968a-5058-4c56-b637-1f8cee3cbbf5 req-a37023bf-ee5a-405a-adbe-e171cc9c9b94 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.278130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-33f4968a-5058-4c56-b637-1f8cee3cbbf5 req-a37023bf-ee5a-405a-adbe-e171cc9c9b94 service nova] Creating event network-vif-plugged:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 15:58:40.283070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-33f4968a-5058-4c56-b637-1f8cee3cbbf5 req-a37023bf-ee5a-405a-adbe-e171cc9c9b94 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Jul 14 15:58:40.283658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 307/570] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:58:40.886970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:40.887591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:40.893872 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.894335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:40.895145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:40.895590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.030299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:41.038584 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aa0ebb07-357b-4f53-990c-b8d5ed264542 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.155521 Jul 14 15:58:41.039160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 264/571] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:40 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:41.274331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:41.274987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:41.281239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.281693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.282488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:41.282928 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:41.414717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:41.423665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:41.425479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:41.426673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1b8aa4a6-c628-43c0-8dfe-1cdae83fd00c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.157849 Jul 14 15:58:41.427278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 308/572] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:41 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:42.059496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:42.060166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:42.066898 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.067358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.068778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.069222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.200442 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.207930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fe901265-7e17-4553-8467-e96b217e06e1 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.152369 Jul 14 15:58:42.208503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 265/573] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:42 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:42.445143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:42.445666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:42.452195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.452656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.453421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:42.453950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:42.584141 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.592852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.594402 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:42.595560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b6d017cd-fb1b-4212-a3ac-bb66c97be891 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.154545 Jul 14 15:58:42.596120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 309/574] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:42 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:43.224867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:43.225479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:43.232031 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.232487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.233253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.233688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.367720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.375258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-293cf4a1-747b-428d-888e-a41ecaa1e0a8 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.154385 Jul 14 15:58:43.375823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 266/575] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:43 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:43.615905 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:43.616479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:43.622963 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.623407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.624167 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:43.624604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:43.759288 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.768413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.769949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:43.771127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-43841136-cde2-4307-9291-0a3bcd7c5c2c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.159797 Jul 14 15:58:43.771687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 310/576] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:43 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:44.392674 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:44.393297 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:44.400977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.404993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.404993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.404993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.635642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:44.643098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-87d59fac-f3c6-429f-bb91-ee3f49160b3c tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1470 microversion: 2.1 time: 0.254322 Jul 14 15:58:44.643674 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 267/577] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:44 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:44.794222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:44.794222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:44.800601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.800601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.801348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.801783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.889262 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-5562773b-59e2-4a88-b963-a2e468efcc82 req-4ccaed8e-7078-4930-8db9-e53551ba6f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c09c057-7b17-46ce-a09b-3c56bbe6836a", "name": "network-vif-deleted", "tag": "7d27a714-3444-43c4-8310-d4f198a8bda7"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:44.900658 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-5562773b-59e2-4a88-b963-a2e468efcc82 req-4ccaed8e-7078-4930-8db9-e53551ba6f28 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:44.901557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-5562773b-59e2-4a88-b963-a2e468efcc82 req-4ccaed8e-7078-4930-8db9-e53551ba6f28 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:44.920318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-5562773b-59e2-4a88-b963-a2e468efcc82 req-4ccaed8e-7078-4930-8db9-e53551ba6f28 service nova] Creating event network-vif-deleted:7d27a714-3444-43c4-8310-d4f198a8bda7 for instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a on hv-cinder-83716 Jul 14 15:58:44.926510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-5562773b-59e2-4a88-b963-a2e468efcc82 req-4ccaed8e-7078-4930-8db9-e53551ba6f28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042803 Jul 14 15:58:44.928006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 268/578] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:44.985632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:44.995791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:45.006936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:45.006936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c90a55b1-36c8-4254-8b11-5630926308a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.219315 Jul 14 15:58:45.010714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 311/579] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:44 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:45.661679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:45.662411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:45.668670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.669114 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:45.669902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:45.670342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:45.741430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:45.749321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7ad8cb3c-5d6d-4cc5-8cda-b6c25e0fd06f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1299 microversion: 2.1 time: 0.092306 Jul 14 15:58:45.751390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 269/580] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:45 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:46.028331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:46.028891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:46.035325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.035806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.036627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.037062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.176028 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.184786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.186437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.187673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-86222df8-54ac-4251-9734-43a27f7d7f5a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.163343 Jul 14 15:58:46.188314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 312/581] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:46 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:46.766895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:46.767521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:46.775176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.775628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.776428 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.776861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.807542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:46.807993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:46.808443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lazy-loading 'fault' on Instance uuid 3c09c057-7b17-46ce-a09b-3c56bbe6836a {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:46.850222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:46.858253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c6a95a78-a644-4cf9-8f0a-ddf01f4b207b tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1304 microversion: 2.1 time: 0.095324 Jul 14 15:58:46.858834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 270/582] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:46 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:47.206764 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:47.207397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:47.214057 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.214500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.215259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.215720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.354847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.359622 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.361116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.362360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-16549299-7363-4a8c-b410-cf22e8e122a1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.159626 Jul 14 15:58:47.362912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 313/583] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:47 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:47.875830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:47.876448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:47.883310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.883770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.884550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.884992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.917611 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:47.918100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:47.918554 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lazy-loading 'fault' on Instance uuid 3c09c057-7b17-46ce-a09b-3c56bbe6836a {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:47.961485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:47.969046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1e69e8b9-684e-41b8-a7af-11d9ac7d5f4f tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1304 microversion: 2.1 time: 0.097151 Jul 14 15:58:47.969621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 271/584] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:47 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:48.381009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:48.381614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:48.388269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.388723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.389484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.389944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.397710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:48.525245 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:48.534047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:48.535568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:48.536814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-aff606f0-46c9-47df-a19b-ef6f8bb2bece tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.160142 Jul 14 15:58:48.537383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 314/585] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:48 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:48.986641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:48.987246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:48.994107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.994721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:48.995490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:48.995925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.027027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:49.027469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.027909 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lazy-loading 'fault' on Instance uuid 3c09c057-7b17-46ce-a09b-3c56bbe6836a {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:49.072491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.080447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5216bcf9-a568-4bbf-86ee-f7048ca8f706 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1304 microversion: 2.1 time: 0.097558 Jul 14 15:58:49.081065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 272/586] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:48 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:49.556481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:49.557103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:49.564401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:49.564984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.565617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:49.566092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:49.712726 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.721236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.722809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:49.724512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50b277ee-efa2-4803-a99a-cbc70a4fed9c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.172004 Jul 14 15:58:49.725077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 315/587] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:49 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:50.153380 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:50.154050 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:50.160586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.161055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.162411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.162853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.193347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.193799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.194272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lazy-loading 'fault' on Instance uuid 3c09c057-7b17-46ce-a09b-3c56bbe6836a {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:50.234869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d08009396541538ae8a3c63cca91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe724e7c19ce44aeb2c84b4e3c5e9290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.242659 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cd0020f1-5463-45bd-8c62-98e111fe6834 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 200 len: 1304 microversion: 2.1 time: 0.093173 Jul 14 15:58:50.243234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 273/588] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:50 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:50.744522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:50.747504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:50.754456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.754909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.755715 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:50.756149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:50.893840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.903413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.904944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:50.906177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b3499516-8582-4c25-b0d0-e329c70e816f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.167018 Jul 14 15:58:50.906744 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 316/589] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:50 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:51.260392 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:51.261079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] [instance: 3c09c057-7b17-46ce-a09b-3c56bbe6836a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:51.268078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.268525 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.269345 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.269790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.285034 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] HTTP exception thrown: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Request method failure captured: Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a HTTP/1.1 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D0BThFYeLh_4ZshTwHG9oN2F5QSEubOvtdGpOHV6mmagDgvUR4wAz1wWslsWmruZn9dxPWbyr8QMRGaZErtjoyLIVW_ggaRtN6YIqVjivu0pfC9WIy4eiz3XehgoQhv2eAsNpICqYa4EneuRSspswf-aaogj8b1zvFIRPXplDeMbBA Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: fe724e7c19ce44aeb2c84b4e3c5e9290 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesNegativeTest-1224312095 Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 15:58:51.286822 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe724e7c19ce44aeb2c84b4e3c5e9290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe724e7c19ce44aeb2c84b4e3c5e9290", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe724e7c19ce44aeb2c84b4e3c5e9290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe724e7c19ce44aeb2c84b4e3c5e9290"}]}] Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesNegativeTest-1224312095 Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: fe724e7c19ce44aeb2c84b4e3c5e9290 Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesNegativeTest-1224312095 Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesNegativeTest-1224312095-project Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c7d08009396541538ae8a3c63cca91f4 Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesNegativeTest-1224312095-project Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. Jul 14 15:58:51.288400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '3c09c057-7b17-46ce-a09b-3c56bbe6836a'} Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:51.300348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. Jul 14 15:58:51.302083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:58:51.303627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] Returning 404 to user: Instance 3c09c057-7b17-46ce-a09b-3c56bbe6836a could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:51.303627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-085d1193-c2a4-4ea0-aa58-e20e3e05ae95 tempest-VolumesNegativeTest-1224312095 tempest-VolumesNegativeTest-1224312095-project] 10.222.0.47 "GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a" status: 404 len: 111 microversion: 2.1 time: 0.031906 Jul 14 15:58:51.303627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 274/590] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:51 2022] GET /compute/v2.1/servers/3c09c057-7b17-46ce-a09b-3c56bbe6836a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:58:51.924890 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:51.925524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:51.933584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.934100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:51.934897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:51.935272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:52.076549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:52.085384 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:52.087733 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:52.088919 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50861b32-1bbc-4dea-9779-b25a7b9a3d2a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1805 microversion: 2.20 time: 0.168315 Jul 14 15:58:52.093106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 317/591] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:51 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:53.109409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:53.110129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:53.118339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:53.118940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:53.119840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:53.120343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:53.547606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:53.557547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:53.559213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:53.560383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-05a87d39-7f4f-47c1-b60b-454ff4622629 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1792 microversion: 2.20 time: 0.455716 Jul 14 15:58:53.560944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 275/592] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:58:53 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1792 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:58:54.230894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:54.231399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:54.238064 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:54.238519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.239539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:54.240228 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:54.369047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'services' on Instance uuid 985107cf-7ae3-42a1-8669-ea261e1b1c2d {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:54.695542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7326beec-09db-4185-8a6c-5904f5a927dd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "DELETE /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d/os-volume_attachments/d631364c-986f-43fe-9741-d87cb51f5bc1" status: 202 len: 0 microversion: 2.1 time: 0.465304 Jul 14 15:58:54.695542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 318/593] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 15:58:54 2022] DELETE /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d/os-volume_attachments/d631364c-986f-43fe-9741-d87cb51f5bc1 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:58:56.863249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:56.863735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:56.869998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.870447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.871205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:56.871639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:56.899391 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:58:56.926150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:57.318713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-660a3ecd-de12-41bb-be73-1ea40903455f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "DELETE /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 204 len: 0 microversion: 2.1 time: 0.459217 Jul 14 15:58:57.319305 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 276/594] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:58:56 2022] DELETE /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:58:57.328400 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:57.329137 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:57.331681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=48 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:57.337462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.337946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.338799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:57.339239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:57.470658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:57.478331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-34256975-14da-428e-b6c4-a90ae06e0a5b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1514 microversion: 2.1 time: 0.154301 Jul 14 15:58:57.478907 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 319/595] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:57 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:58.496246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:58.496937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:58.503506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.503953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.504723 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:58.505189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:58.644070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:58.652607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8fcd44d8-5571-4013-8775-66c5d93f05b3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1514 microversion: 2.1 time: 0.160639 Jul 14 15:58:58.653184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 277/596] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:58 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:59.672552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.673096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.680244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.680698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.682053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.682053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.823668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:59.831314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b1e2fe04-04b2-474c-9e9a-7010c391c187 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1514 microversion: 2.1 time: 0.162697 Jul 14 15:58:59.831892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 320/597] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:59 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:00.666082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-09c228b8-172c-4090-a509-d63add94343b req-7f9a2633-da85-46ad-a6bd-deeceec9848f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985107cf-7ae3-42a1-8669-ea261e1b1c2d", "name": "network-vif-deleted", "tag": "3943d8e5-7af8-4ed5-937d-4c847a3532ef"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:00.675038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-09c228b8-172c-4090-a509-d63add94343b req-7f9a2633-da85-46ad-a6bd-deeceec9848f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.675473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-09c228b8-172c-4090-a509-d63add94343b req-7f9a2633-da85-46ad-a6bd-deeceec9848f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.686977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-09c228b8-172c-4090-a509-d63add94343b req-7f9a2633-da85-46ad-a6bd-deeceec9848f service nova] Creating event network-vif-deleted:3943d8e5-7af8-4ed5-937d-4c847a3532ef for instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d on hv-cinder-83716 Jul 14 15:59:00.691776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-09c228b8-172c-4090-a509-d63add94343b req-7f9a2633-da85-46ad-a6bd-deeceec9848f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029662 Jul 14 15:59:00.692394 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 278/598] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:00.849092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:00.849868 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:00.856401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.856854 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.857632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:00.858224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:00.922633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:00.931546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6cfe2825-e4d0-4ce9-8660-f1e0d3532470 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1472 microversion: 2.1 time: 0.086493 Jul 14 15:59:00.932141 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 321/599] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:00 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:01.951170 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:01.952551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:01.959601 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.960056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:01.960830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:01.961267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:02.032470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:02.041020 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-69560ca1-f0ab-4d78-b199-caeaf3fc30a9 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1472 microversion: 2.1 time: 0.094674 Jul 14 15:59:02.052639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 279/600] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:01 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:03.062481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:03.063103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:03.070423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.070903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:03.071690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:03.072130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:03.149471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:03.161683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-123f3475-efb7-4f89-9077-74b2eb1bb29a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1472 microversion: 2.1 time: 0.103332 Jul 14 15:59:03.163041 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 322/601] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:03 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1472 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:04.180717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:04.183853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:04.188792 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:04.189246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.190719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:04.190719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.227585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:04.228037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:04.228533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 985107cf-7ae3-42a1-8669-ea261e1b1c2d {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:04.272181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:04.280022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d09c24a6-7a9c-4aa0-a4fe-9b503a3588f3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 200 len: 1309 microversion: 2.1 time: 0.104194 Jul 14 15:59:04.280807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 280/602] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:04 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:05.300473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:05.301644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 985107cf-7ae3-42a1-8669-ea261e1b1c2d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:05.308473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.309160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:05.319362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:05.319362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:05.328612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] HTTP exception thrown: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Request method failure captured: Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d HTTP/1.1 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DzXp1gIY5Z6cm7rYaICK1qAYBMOX6fB50EeSa2fW5-K6Dv7XB-Y3727SRub72TflGMuxk5UZUuUo3gyPhj1VKLR9ALrWyEUvhnrgkag7DmYHVtguHCm4cR_5xSitW7WLk8nUKpn-Or6TWrRegsLDo0b4G3UPUlXPnhTELdIKTm7Mn8 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: d16ae801ca124180b78f2fce16acc4f7 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:59:05.330557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16ae801ca124180b78f2fce16acc4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d16ae801ca124180b78f2fce16acc4f7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16ae801ca124180b78f2fce16acc4f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d16ae801ca124180b78f2fce16acc4f7"}]}] Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: d16ae801ca124180b78f2fce16acc4f7 Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesSnapshotTestJSON-15214121-project Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 54fcab272d7946c69aac92f6d3030942 Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesSnapshotTestJSON-15214121-project Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. Jul 14 15:59:05.333687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '985107cf-7ae3-42a1-8669-ea261e1b1c2d'} Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:05.335146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. Jul 14 15:59:05.337380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:05.339492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Returning 404 to user: Instance 985107cf-7ae3-42a1-8669-ea261e1b1c2d could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:05.339492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce8ef6dd-9012-4134-baf3-6972c32b2541 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d" status: 404 len: 111 microversion: 2.1 time: 0.036899 Jul 14 15:59:05.339492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 323/603] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:05 2022] GET /compute/v2.1/servers/985107cf-7ae3-42a1-8669-ea261e1b1c2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:13.944655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:13.945359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:13.954124 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:13.954578 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:13.956249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:13.956933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:13.966763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-80db98c4-5783-49c5-9e48-7a5043ed4482 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Action: 'create', calling method: .version_select at 0x7f33ff685ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2067800923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ1IZcj/BJX/124r1Ezt2TRaY5RQvKgT1DN6+2rrZn/pSEn2NoGx7HiKmuz+f13dUiy6x6PeRsDLwuX6JEEOCB1mhu1iagzkBbmDnL6fmZWZgGHSC9DoVD9coxANyoRQw=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:13.971426 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:13.983125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-80db98c4-5783-49c5-9e48-7a5043ed4482 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:13.983603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e936b1e3-8c97-469b-97ec-e667514be229 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/ips" status: 200 len: 149 microversion: 2.1 time: 0.044688 Jul 14 15:59:13.988916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 324/604] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 15:59:13 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:13.998008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-80db98c4-5783-49c5-9e48-7a5043ed4482 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for user ba765c1a8c6c449ca699eb7a44dde50b and project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:13.998383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "425cad83-65fe-40c8-a45c-a99aea25b79c"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:13.999694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:14.006839 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.007716 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.009101 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.009665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.121417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: POST /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/os-volume_attachments HTTP/1.1 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 74 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:59:14.127008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {"volumeAttachment": {"volumeId": "425cad83-65fe-40c8-a45c-a99aea25b79c"}} Jul 14 15:59:14.128613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'server_id': 'dd607e1d-a8e4-4d78-9624-ca81454a3b76', 'body': {'volumeAttachment': {'volumeId': '425cad83-65fe-40c8-a45c-a99aea25b79c'}}} Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:14.129564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:14.131529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:14.132935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 400 to user: Invalid volume: volume 425cad83-65fe-40c8-a45c-a99aea25b79c is already attached to instances: 868856cc-c674-43d8-bd8d-3e579171b462 {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:14.133679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6959517a-a844-4de1-b136-61590efff971 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137863 Jul 14 15:59:14.137270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 325/605] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:59:13 2022] POST /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:59:14.142845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:14.143356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:14.150716 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.151165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.151935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.152370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.165215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-80db98c4-5783-49c5-9e48-7a5043ed4482 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.395244 Jul 14 15:59:14.165854 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 281/606] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:59:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:14.188875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:59:14.638329 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c8c85733-cda4-41cd-89ed-8640d8201df0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 204 len: 0 microversion: 2.1 time: 0.498975 Jul 14 15:59:14.638923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 326/607] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:59:14 2022] DELETE /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:59:14.644015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:14.648641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:14.649341 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:14.657128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.657884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.658890 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:14.659336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:14.815226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:14.823019 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0f31d804-0737-441e-a061-c1199470f675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1680 microversion: 2.1 time: 0.179832 Jul 14 15:59:14.823589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 282/608] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:14 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:15.841561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:15.842308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:15.848999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:15.849451 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:15.850264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:15.851234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:15.995804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:16.006094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2b26c434-1248-4e57-9c37-c16fb098f059 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1680 microversion: 2.1 time: 0.168654 Jul 14 15:59:16.006851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 327/609] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:15 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:17.025298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:17.026047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:17.034188 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:17.034745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:17.036395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:17.036847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:17.243554 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:17.252579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d1e5d205-6bd9-4f7a-a875-c503d992139c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1680 microversion: 2.1 time: 0.231962 Jul 14 15:59:17.253170 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 283/610] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:17 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:18.269077 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:18.269757 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:18.277234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:18.278031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:18.278828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:18.279260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:18.430947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:18.439328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-74c43986-e3ff-430f-82be-6fa8ea3c9039 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1680 microversion: 2.1 time: 0.174006 Jul 14 15:59:18.439907 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 328/611] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:18 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:18.642235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-708572274", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "networks": [{"uuid": "87cdf084-dc76-42c2-ae63-5e71b86be3a9"}]}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:18.711468 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] validate_networks() for [('87cdf084-dc76-42c2-ae63-5e71b86be3a9', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:19.115644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:19.116148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:19.116827 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:19.117410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:19.118007 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:19.131298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.132066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:19.133184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.134033 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:19.160967 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Getting quotas for project d16ae801ca124180b78f2fce16acc4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:19.165646 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Getting quotas for user 54fcab272d7946c69aac92f6d3030942 and project d16ae801ca124180b78f2fce16acc4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:19.178201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:19.180504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:19.322925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7208ffe9-fc6a-4273-a0d4-50af0a85ddf8 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685948 Jul 14 15:59:19.324787 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 284/612] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:59:19.335810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cd114833-5d97-4c1a-a200-93e00682761e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:19.337341 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cd114833-5d97-4c1a-a200-93e00682761e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:19.399086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cd114833-5d97-4c1a-a200-93e00682761e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:19.406700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cd114833-5d97-4c1a-a200-93e00682761e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1218 microversion: 2.1 time: 0.075670 Jul 14 15:59:19.409133 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 329/613] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:19 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:19.456732 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:19.458249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:19.465237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.465758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:19.466514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:19.467066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:20.041708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:20.053743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b0de87f4-08c2-46f7-aa10-8708f562af56 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1680 microversion: 2.1 time: 0.600960 Jul 14 15:59:20.071127 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 285/614] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:19 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1680 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:20.425991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:20.427379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:20.437266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:20.438014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:20.439000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:20.439567 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:20.444024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:20.544625 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:20.553654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5d178634-54d3-4829-8d9d-7de4c38f2f85 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1222 microversion: 2.1 time: 0.132290 Jul 14 15:59:20.554299 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 330/615] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:20 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:21.079064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:21.079747 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:21.091896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:21.092810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.094057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:21.094540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.146900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-a85eed28-98bc-439c-8359-a8546c8cf849 req-eabe0716-6e6a-48b1-928b-194dff55c73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd607e1d-a8e4-4d78-9624-ca81454a3b76", "name": "network-vif-deleted", "tag": "ce7c554f-9081-45fc-b4d3-8e80e04e0129"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:21.163752 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a85eed28-98bc-439c-8359-a8546c8cf849 req-eabe0716-6e6a-48b1-928b-194dff55c73d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:21.164491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a85eed28-98bc-439c-8359-a8546c8cf849 req-eabe0716-6e6a-48b1-928b-194dff55c73d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.181040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:21.182366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-a85eed28-98bc-439c-8359-a8546c8cf849 req-eabe0716-6e6a-48b1-928b-194dff55c73d service nova] Creating event network-vif-deleted:ce7c554f-9081-45fc-b4d3-8e80e04e0129 for instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 on hv-cinder-83716 Jul 14 15:59:21.187611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-a85eed28-98bc-439c-8359-a8546c8cf849 req-eabe0716-6e6a-48b1-928b-194dff55c73d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044968 Jul 14 15:59:21.188279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 331/616] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:21.191729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-932ae1be-12c0-4c64-8f5c-0c6f0f875014 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1612 microversion: 2.1 time: 0.116626 Jul 14 15:59:21.192908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 286/617] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:21 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1612 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:21.572340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:21.573069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:21.580265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:21.580706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.581652 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:21.582239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:21.651328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:21.659115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-df975ec6-d0d7-49d2-99c2-4de970cc031f tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1270 microversion: 2.1 time: 0.092142 Jul 14 15:59:21.659693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 332/618] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:21 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:22.215441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:22.216547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:22.229695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.235318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.235318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.235318 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.268049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.268508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.269014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid dd607e1d-a8e4-4d78-9624-ca81454a3b76 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:22.327627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:22.337170 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f17b645d-8c80-4272-8727-ebc8c622460c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 200 len: 1330 microversion: 2.1 time: 0.130261 Jul 14 15:59:22.350402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 287/619] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:22 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:22.677324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:22.678072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:22.685968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.687301 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.688347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:22.688811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:22.783235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:22.794075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-adf12a33-3dc2-4b70-84bd-76e7c7ea4334 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1278 microversion: 2.1 time: 0.121309 Jul 14 15:59:22.797850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 333/620] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:22 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:23.368199 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:23.369068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:23.390238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.390238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.390238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.390238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.409849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 HTTP/1.1 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 15:59:23.411847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 15:59:23.413286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'dd607e1d-a8e4-4d78-9624-ca81454a3b76'} Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:23.414107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 15:59:23.415357 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 15:59:23.417863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:23.417863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-afda16ce-fe8b-4929-a4eb-0ba66d07f2e9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 404 len: 111 microversion: 2.1 time: 0.052416 Jul 14 15:59:23.417863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 288/621] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:23 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:23.423667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-af383bc6-54f8-4775-a95d-1ce3c3af9479 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '.version_select at 0x7f33ffe79af0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:23.620468 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-af383bc6-54f8-4775-a95d-1ce3c3af9479 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639708616" status: 202 len: 0 microversion: 2.1 time: 0.201542 Jul 14 15:59:23.621095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 334/622] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 14 15:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639708616 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:23.811920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:23.812527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:23.819046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.819493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:23.820283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:23.820719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:24.101683 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:24.110890 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2dfa917a-63bc-46b7-bf6d-e1383e5da4f7 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.302806 Jul 14 15:59:24.111471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 289/623] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:23 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:24.668740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:24.669280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:24.676981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:24.677501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:24.678565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:24.679116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:24.766060 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'services' on Instance uuid 868856cc-c674-43d8-bd8d-3e579171b462 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:25.133211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:25.135181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:25.143672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.144130 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.144983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.145574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d9f310cc-0998-4c5e-a370-ed2a5623d400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments/425cad83-65fe-40c8-a45c-a99aea25b79c" status: 202 len: 0 microversion: 2.1 time: 0.481304 Jul 14 15:59:25.145707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.146208 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 335/624] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 15:59:24 2022] DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments/425cad83-65fe-40c8-a45c-a99aea25b79c => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:25.156197 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-ffe452b9-670b-4678-83d0-4315ddb1ac57 req-9f1dd717-18d0-431b-80fa-3d608fdd0857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619c1920-2cc9-4d28-97f0-71d28cc768f6", "tag": "85cd0e82-ac8a-403f-a673-808c61927e38"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:25.170417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-ffe452b9-670b-4678-83d0-4315ddb1ac57 req-9f1dd717-18d0-431b-80fa-3d608fdd0857 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.170941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-ffe452b9-670b-4678-83d0-4315ddb1ac57 req-9f1dd717-18d0-431b-80fa-3d608fdd0857 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.184263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-ffe452b9-670b-4678-83d0-4315ddb1ac57 req-9f1dd717-18d0-431b-80fa-3d608fdd0857 service nova] Creating event network-changed:85cd0e82-ac8a-403f-a673-808c61927e38 for instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 on hv-cinder-83716 Jul 14 15:59:25.189243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-ffe452b9-670b-4678-83d0-4315ddb1ac57 req-9f1dd717-18d0-431b-80fa-3d608fdd0857 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037674 Jul 14 15:59:25.189882 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 336/625] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:25.196037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:25.197042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:25.203600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.205240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.205240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:25.205992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:25.237271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c8212682-c336-4b01-8b0d-b786490ffc68 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Jul 14 15:59:25.239473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 337/626] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:25 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:25.403312 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:25.412811 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3e2bd082-d6ae-468b-bae5-ffca9ce84d5d tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.286007 Jul 14 15:59:25.413648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 290/627] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:25 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:26.250205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:26.251424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:26.265682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.266715 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.267661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.268265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.314631 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b971714d-facc-4977-bb1f-d301ca6d784c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067463 Jul 14 15:59:26.319747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 338/628] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:26 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:26.431331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:26.431964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:26.438347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.438848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.439631 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:26.440161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:26.641159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:26.649676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a68e6643-fbfd-49a0-be8c-8a0a1ed628bd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.223435 Jul 14 15:59:26.650660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 291/629] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:26 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:27.327996 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:27.329063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:27.336000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.336478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:27.337311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.337791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:27.370875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3a0e1a66-7feb-4589-bc52-5bc7d544c5d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Jul 14 15:59:27.371454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 339/630] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:27 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:27.667307 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:27.668097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:27.675191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.675649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:27.676501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:27.676940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:27.829572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:27.838120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3369495c-bba5-4424-b791-ab94957415c4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.174968 Jul 14 15:59:27.838758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 292/631] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:27 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:28.383469 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:28.384308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:28.386779 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:28.391657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.392112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.392882 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.393325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.426813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1e10a088-1be5-444e-a92c-d47cab0f6aaa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047800 Jul 14 15:59:28.427614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 340/632] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:28 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:59:28.489551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:28.490104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:28.496620 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.497110 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.497934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.498416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.525542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:59:28.855621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:28.856247 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:28.864545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.864545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.864796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.865086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.922265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8e83e46a-b605-4079-8077-f0ea459a8d1e tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 204 len: 0 microversion: 2.1 time: 0.436445 Jul 14 15:59:28.923072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 293/633] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 15:59:28 2022] DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:59:28.933705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:28.934456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:28.940798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.941545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:28.942479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:28.943009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:29.010188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:29.018639 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-106dcef9-c802-4a9c-9682-0580dd951a79 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.166952 Jul 14 15:59:29.019264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 341/634] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:28 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:29.095784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:29.104710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-515ec91e-7b69-4e0b-9e30-62c19e25930b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1680 microversion: 2.1 time: 0.176293 Jul 14 15:59:29.105308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 294/635] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:28 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:30.036874 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:30.037491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:30.040013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:30.045284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.045730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:30.046527 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.046959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:30.122447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:30.123740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:30.126301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:30.127721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=10 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:30.133992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.134451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:30.135408 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:30.135850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:30.184159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:30.196324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-75d863f5-be8e-422d-a246-37cf49c978a4 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.164247 Jul 14 15:59:30.196933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 342/636] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:30 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:30.280958 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:30.288518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-067100d0-7c64-4610-aa9c-6ed0090e8355 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1680 microversion: 2.1 time: 0.170059 Jul 14 15:59:30.289100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 295/637] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:30 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:31.019685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a15b5ba-fcdd-4b08-b2f7-f53fb703e019"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:31.021576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:31.101847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.102523 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.103636 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.104443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.214221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:31.214802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:31.222062 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.222511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.223312 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.223744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.362294 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:31.370453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-00464cd5-8e65-47b2-9d92-07d02919b070 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.160440 Jul 14 15:59:31.371026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 296/638] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:31 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:31.376103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:31.376843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:31.384363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.384823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.385607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.386080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.635605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:31.639171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.643816 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ba36d99d-48ee-42fb-90b5-b79c03959909 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1680 microversion: 2.1 time: 0.271740 Jul 14 15:59:31.644702 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 297/639] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:31 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:31.820349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-98cae920-e994-41b7-8c90-505822ccab95 req-677a8fea-6810-4d86-aff9-462ee47752b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619c1920-2cc9-4d28-97f0-71d28cc768f6", "name": "network-vif-plugged", "status": "completed", "tag": "85cd0e82-ac8a-403f-a673-808c61927e38"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:31.828654 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-98cae920-e994-41b7-8c90-505822ccab95 req-677a8fea-6810-4d86-aff9-462ee47752b8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.829096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-98cae920-e994-41b7-8c90-505822ccab95 req-677a8fea-6810-4d86-aff9-462ee47752b8 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.858116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-98cae920-e994-41b7-8c90-505822ccab95 req-677a8fea-6810-4d86-aff9-462ee47752b8 service nova] Creating event network-vif-plugged:85cd0e82-ac8a-403f-a673-808c61927e38 for instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 on hv-cinder-83716 Jul 14 15:59:31.858116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-98cae920-e994-41b7-8c90-505822ccab95 req-677a8fea-6810-4d86-aff9-462ee47752b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036638 Jul 14 15:59:31.858116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 298/640] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:32.388987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:32.389698 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:32.396670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.397137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.397953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.398400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.599711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ae0ff477-f0ad-4396-95b9-be04b2fbbe03 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.584209 Jul 14 15:59:32.627767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 343/641] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:59:31 2022] POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments => generated 194 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:32.663994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:32.664702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:32.683364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.683567 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.684627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.685232 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.806024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:32.817498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50a6a34b-4495-4966-85e5-ba35864fab55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1613 microversion: 2.1 time: 0.157255 Jul 14 15:59:32.818413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 344/642] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:32 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:33.063634 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-7e96174b-7ac3-4b4d-9d46-a6787267d435 req-d066f037-a1b7-4d96-85c7-c2f32c05542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868856cc-c674-43d8-bd8d-3e579171b462", "name": "network-vif-deleted", "tag": "d4081dea-6bfc-40cc-a45c-ca2d8813c468"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:33.073520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7e96174b-7ac3-4b4d-9d46-a6787267d435 req-d066f037-a1b7-4d96-85c7-c2f32c05542e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.074287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-7e96174b-7ac3-4b4d-9d46-a6787267d435 req-d066f037-a1b7-4d96-85c7-c2f32c05542e service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.089998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:33.093278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-7e96174b-7ac3-4b4d-9d46-a6787267d435 req-d066f037-a1b7-4d96-85c7-c2f32c05542e service nova] Creating event network-vif-deleted:d4081dea-6bfc-40cc-a45c-ca2d8813c468 for instance 868856cc-c674-43d8-bd8d-3e579171b462 on hv-cinder-83716 Jul 14 15:59:33.099045 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-7e96174b-7ac3-4b4d-9d46-a6787267d435 req-d066f037-a1b7-4d96-85c7-c2f32c05542e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039391 Jul 14 15:59:33.099267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7d919fd5-36b4-44b2-a7c2-3b58799bcc5c tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.714275 Jul 14 15:59:33.101187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 299/643] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:32 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:33.102561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 345/644] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:33.835122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:33.835745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:33.843416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.844216 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.845165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.845761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.879848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.880585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.881211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 868856cc-c674-43d8-bd8d-3e579171b462 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:33.947696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:33.948831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1ff3c79c-b134-4f54-ac9b-a5584423e932 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1331 microversion: 2.1 time: 0.114904 Jul 14 15:59:33.958821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 300/645] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:33 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:34.116903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:34.117792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:34.124354 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.124784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.125557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.131899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.266831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:34.275072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-89d59b31-151c-47a8-9987-df9a80258096 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1318 microversion: 2.1 time: 0.163650 Jul 14 15:59:34.275714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 346/646] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:34 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:34.881324 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:34.882276 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:34.889502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.890008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.890980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.891523 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.968838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:34.969547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:34.977701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.984416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.984416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.984416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.014203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.014772 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.015604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 868856cc-c674-43d8-bd8d-3e579171b462 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:35.018803 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:35.045975 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lazy-loading 'services' on Instance uuid c14712f2-30e1-4219-a304-3769e1912a99 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:35.065571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:35.074912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c0072dcc-8341-4ca2-b176-ca2ecb1d7e98 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 200 len: 1331 microversion: 2.1 time: 0.112108 Jul 14 15:59:35.076239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 347/647] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:34 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:35.292380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:35.292984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:35.299809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.300266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.301169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.301614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.350831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3acaff36-37a8-4cef-9180-b6f609e4e153 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments/6230e2ee-30b6-4cf8-a02e-cb9f9ab04ea7" status: 202 len: 0 microversion: 2.1 time: 0.473789 Jul 14 15:59:35.351758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 301/648] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 15:59:34 2022] DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments/6230e2ee-30b6-4cf8-a02e-cb9f9ab04ea7 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:35.473589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:35.482529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-93996553-2284-4564-8d91-096c3d446be2 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1506 microversion: 2.1 time: 0.193966 Jul 14 15:59:35.483352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 348/649] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:35 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:35.503160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bade9be3-7168-4680-9213-642b947ef8dd", "device": "/dev/sdb"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:35.505110 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:35.513192 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.513673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.514536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:35.514981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.093989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:36.094598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:36.100980 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.101431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.102263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.102720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.117363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 HTTP/1.1 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 15:59:36.119100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 15:59:36.120896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '868856cc-c674-43d8-bd8d-3e579171b462'} Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:36.121755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 15:59:36.123385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 15:59:36.124559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:36.124559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6e4b5746-2379-4491-af81-2be9416dce62 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jul 14 15:59:36.124559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 349/650] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:36 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:59:36.129075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4cdca36b-033d-40be-9535-3d2862fd95e4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '.version_select at 0x7f33ffe45670>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:36.330197 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4cdca36b-033d-40be-9535-3d2862fd95e4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530033389" status: 202 len: 0 microversion: 2.1 time: 0.204428 Jul 14 15:59:36.330832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 350/651] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 14 15:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530033389 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:59:36.920480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-dfe65f7e-718e-427e-bce9-39ee7a2a4c2a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "POST /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.421562 Jul 14 15:59:36.921905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 302/652] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 15:59:35 2022] POST /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6/os-volume_attachments => generated 194 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:37.483585 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-656f3efc-89e7-4297-a5c2-9ebc3297ef30 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: .version_select at 0x7f33ff54d280>, body: {"keypair": {"name": "tempest-keypair-1881784164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdhvuMW+J0roz8dgeSZwTzMNAHZJ+MSLnl4AWRIjgJ9Agij+WQQL/QKbhfllrxbUu7Ziv+STc3F/pS0VUnTFTwiYd/LaC175upXZCv9Wd4N88gFaowSlR+jYk8mK950Qg=="}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:37.509688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-656f3efc-89e7-4297-a5c2-9ebc3297ef30 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:37.514255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-656f3efc-89e7-4297-a5c2-9ebc3297ef30 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:37.603338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-656f3efc-89e7-4297-a5c2-9ebc3297ef30 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127187 Jul 14 15:59:37.603952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 351/653] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 15:59:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:40.606447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1674395669", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761c7f07-2b9f-4965-8183-b20363082c34"}], "security_groups": [{"name": "tempest-securitygroup--1710156837"}], "key_name": "tempest-keypair-1881784164", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:40.722006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] validate_networks() for [('761c7f07-2b9f-4965-8183-b20363082c34', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:41.034492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-168484331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2067800923", "security_groups": [{"name": "tempest-secgroup-smoke-916256028"}], "block_device_mapping_v2": [{"uuid": "654778f3-7f75-438d-a4f7-8072af857ee3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6678e1c-1ac9-413e-832a-e75939816f1b"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:41.170616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:41.171239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:41.172101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:41.172913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:41.173585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:41.183119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] validate_networks() for [('c6678e1c-1ac9-413e-832a-e75939816f1b', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:41.196793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.199083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.203726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.203726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.242853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:41.248029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:41.259926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:41.262402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:41.395519 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-867beaaa-e08c-4c8b-9d15-fa51c2f5d51d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.793219 Jul 14 15:59:41.396281 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 303/654] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:59:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:59:41.403386 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:41.404788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:41.423163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.423821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.425088 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.425626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.462366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'flavor' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:41.655643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:41.656072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:41.656595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:41.657003 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:41.657448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:41.667436 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.668015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.668848 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.676845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.688881 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:41.692889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for user ba765c1a8c6c449ca699eb7a44dde50b and project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:41.753704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:41.756180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='654778f3-7f75-438d-a4f7-8072af857ee3',volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:41.956599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6f8e99e7-b604-4f9c-989d-98fff6ff76ac tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/action" status: 200 len: 32 microversion: 2.1 time: 0.558463 Jul 14 15:59:41.958070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 304/655] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:59:41 2022] POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/action => generated 32 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:59:41.964172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a61839c4-f729-4ed5-b783-a53483fcf400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:41.965158 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a61839c4-f729-4ed5-b783-a53483fcf400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:41.975985 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:42.031207 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a61839c4-f729-4ed5-b783-a53483fcf400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.040590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a61839c4-f729-4ed5-b783-a53483fcf400 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1242 microversion: 2.1 time: 0.080726 Jul 14 15:59:42.050399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 305/656] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:41 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:42.050399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.050399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.054054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.054517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.055322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.055769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.236136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.253103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a0f636ec-9561-452b-8ae3-38215c862643 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.210409 Jul 14 15:59:42.253738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 306/657] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:42.301701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e3cd0a89-c667-4ae0-bd72-ea0b849c0560 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:42.308009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e3cd0a89-c667-4ae0-bd72-ea0b849c0560 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.308595 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e3cd0a89-c667-4ae0-bd72-ea0b849c0560 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.374643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e3cd0a89-c667-4ae0-bd72-ea0b849c0560 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Going to try to stop instance {{(pid=129991) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:59:42.395615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a2f90cc0-4504-4d68-9cbc-47ada9c21c56 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.365373 Jul 14 15:59:42.402185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 352/658] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 15:59:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:59:42.407349 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-40945f34-b95c-410b-8866-90c429133e44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.407988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-40945f34-b95c-410b-8866-90c429133e44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.469264 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-40945f34-b95c-410b-8866-90c429133e44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.479985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-40945f34-b95c-410b-8866-90c429133e44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1094 microversion: 2.1 time: 0.076539 Jul 14 15:59:42.481342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 353/659] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:42.635509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e3cd0a89-c667-4ae0-bd72-ea0b849c0560 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action" status: 202 len: 0 microversion: 2.1 time: 0.337466 Jul 14 15:59:42.639371 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 307/660] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 15:59:42 2022] POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:42.644495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.646263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.653179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.653632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.654575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.655039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.797545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.806778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-75c0bf96-bed9-4a6f-a1e1-e8716d1dee12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.166074 Jul 14 15:59:42.807570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 354/661] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:43.059915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.060641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.067644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.068376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.069030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.069468 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.138336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.146223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0efebdf7-7164-4482-b052-ab3b2f10eef0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1246 microversion: 2.1 time: 0.090673 Jul 14 15:59:43.146774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 308/662] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:43.275237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.281889 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.284189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.284772 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.286488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.286999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.443863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.452799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-783118eb-8f5d-4971-a78f-f05735631a8d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.183235 Jul 14 15:59:43.453417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 355/663] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:43.499679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0aa978cb-782f-4d44-8d02-31f9f6160b63 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.500296 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0aa978cb-782f-4d44-8d02-31f9f6160b63 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.568513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0aa978cb-782f-4d44-8d02-31f9f6160b63 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.578250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0aa978cb-782f-4d44-8d02-31f9f6160b63 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1094 microversion: 2.1 time: 0.083414 Jul 14 15:59:43.578891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 309/664] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:43.827685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.828620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.836175 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.853190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.853190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.853190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.978519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.986139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d3264820-a4f8-4300-8992-8201261748c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.165161 Jul 14 15:59:43.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 356/665] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:44.164846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:44.165616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:44.173116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.173578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.174631 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.175071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.244588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.252542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d6c058c7-5a9e-40f0-a65e-89612bf287c4 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1294 microversion: 2.1 time: 0.092811 Jul 14 15:59:44.253131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 310/666] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:44.471852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:44.473772 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:44.480349 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.480843 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.481630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.482102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.598474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:44.599907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:44.607516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.608495 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.610238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.610910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.627082 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.636688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-92e6eb7a-f179-4771-ade7-6bd1d5a8b44f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.168755 Jul 14 15:59:44.639645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 357/667] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:44.718280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.727901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-56a0bff2-da67-4c87-a99c-c2b28c279aaa tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1144 microversion: 2.1 time: 0.135510 Jul 14 15:59:44.728710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 311/668] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:45.006723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.007492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.016232 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.016681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.017453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.017908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.259292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.272591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.274384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.289445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-653d7ac7-4b23-4ac2-a3db-c91c80e28910 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.288347 Jul 14 15:59:45.290829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 358/669] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.292777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.293500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.294611 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.300039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.300675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.307535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.324816 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.325488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.326377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.327027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.331359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:45.365573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4733155d-b66f-4ed9-a526-e36602020239 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments/63d9dcab-d343-4802-b270-629031a044e8" status: 200 len: 194 microversion: 2.20 time: 0.069549 Jul 14 15:59:45.366655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 359/670] 10.222.0.47 () {60 vars in 1453 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments/63d9dcab-d343-4802-b270-629031a044e8 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:45.403507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.414672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1d039ece-13c3-47ce-b685-6cafc195ae91 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1300 microversion: 2.1 time: 0.147411 Jul 14 15:59:45.416205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 312/671] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.457658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.458189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.464405 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.464862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.465641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.466119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.568506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'services' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:45.661902 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.677418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.677418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.677418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.677418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.677799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.837755 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.846541 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-29d037d2-cfca-4244-a29a-6272e6a59c7a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.189302 Jul 14 15:59:45.847126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 313/672] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:45.854412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.855505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.863930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.864406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.865179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.865619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.965878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7bca95f3-7a1e-497d-8028-3551d6c10d6e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments/63d9dcab-d343-4802-b270-629031a044e8" status: 202 len: 0 microversion: 2.20 time: 0.510967 Jul 14 15:59:45.966276 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.967685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 360/673] 10.222.0.47 () {60 vars in 1456 bytes} [Thu Jul 14 15:59:45 2022] DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments/63d9dcab-d343-4802-b270-629031a044e8 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:59:45.976175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a36da4aa-6676-407e-b6b6-3c549568cbae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1192 microversion: 2.1 time: 0.127947 Jul 14 15:59:45.976944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 314/674] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.986579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.987942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.995048 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.996086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.997136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.997805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.047174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50e4d223-bd7d-442b-916c-1dd40a1bc905 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074696 Jul 14 15:59:46.052120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 361/675] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:46.376452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.376452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:46.376452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.376452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.377957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.377957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.437871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.438842 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:46.453331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.454428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.455314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.455984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.662376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:46.671136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-435c4f64-d1c3-4113-8c38-0a4b79e473aa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.237978 Jul 14 15:59:46.671734 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 362/676] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:46.754941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:46.763740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fd5e0f7e-8349-402f-a75b-3227f97c6f30 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.449712 Jul 14 15:59:46.764708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 315/677] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:46.865864 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.866869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:46.874885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.875953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.876362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.876809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.994821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.995441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:47.005013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.005518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.006606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.007282 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.075504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:47.085645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ca2450c9-fc8d-42ec-9d6d-4d75d32195ae tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.224919 Jul 14 15:59:47.096364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 363/678] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:47.102687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:47.103817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:47.109521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:47.111132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.116295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.116295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.116295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.127284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-043faffc-b587-40eb-98f5-931a83b8766b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1210 microversion: 2.1 time: 0.136658 Jul 14 15:59:47.127901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 316/679] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:47.156863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-87beff41-4d1a-4b05-9168-d3bbd34ba667 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058902 Jul 14 15:59:47.157861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 364/680] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:47 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:47.391415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-655dfafa-47d7-4281-b492-d1aaa926e2c2 req-219f9905-603a-435c-8ead-fdbd27a217ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bd946f-13d5-4770-902b-142bc1dfb76a", "tag": "571cdd06-9071-4e46-9c3b-2bddee54f4f9"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:47.400406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-655dfafa-47d7-4281-b492-d1aaa926e2c2 req-219f9905-603a-435c-8ead-fdbd27a217ff service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.400846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-655dfafa-47d7-4281-b492-d1aaa926e2c2 req-219f9905-603a-435c-8ead-fdbd27a217ff service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.414242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-655dfafa-47d7-4281-b492-d1aaa926e2c2 req-219f9905-603a-435c-8ead-fdbd27a217ff service nova] Creating event network-changed:571cdd06-9071-4e46-9c3b-2bddee54f4f9 for instance 33bd946f-13d5-4770-902b-142bc1dfb76a on hv-cinder-83716 Jul 14 15:59:47.422355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-655dfafa-47d7-4281-b492-d1aaa926e2c2 req-219f9905-603a-435c-8ead-fdbd27a217ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 Jul 14 15:59:47.423630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 317/681] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:47.689012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:47.690743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:47.708475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.708991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.709886 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.710408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.786408 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:47.787581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:47.797082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.798380 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.800179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.801117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.874382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:47.885624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e882a9d8-009f-4318-8fa2-ff2bbc7fb6b2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.200668 Jul 14 15:59:47.887130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 365/682] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:47 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:48.040067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:48.047833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-68e07e1a-df9c-4ab5-94da-3e5e31e56f3f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.267240 Jul 14 15:59:48.048407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 318/683] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:47 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:48.104697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.105311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.111377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.111832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.112606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.113041 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.145629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.146790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.153390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.153877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.154733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.155191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.292536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:48.298553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:48.301491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f22ce911-cb4c-4fde-a31d-a3cde272aa75 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.201586 Jul 14 15:59:48.302256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 366/684] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:48.306670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-835f9461-6c97-4750-a137-e5b1e8f1aca8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.165777 Jul 14 15:59:48.307231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 319/685] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:48.307689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.309025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.318739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.319205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.319997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.320449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.347939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:48.354694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d87265ce-ffe3-4ef2-86c5-2a789792726c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051319 Jul 14 15:59:48.355296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 367/686] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:48.906192 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.906746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.915144 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.915691 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.917009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.917504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.067082 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.068990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.076799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.077296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.078385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.078899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.255850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.260875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.261102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-727a5deb-4aa0-432a-b3ec-d53df6bb5569 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.198901 Jul 14 15:59:49.261504 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 368/687] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:49.275836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-236551ff-9f3f-4189-9b17-adad54d1f553 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.375109 Jul 14 15:59:49.276690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 320/688] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:49.323132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.323862 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.324504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.325133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.332866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.333630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.334698 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.335278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.338386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.338877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.352449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.352449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.496675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.505082 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4e872bb9-d7c2-44a4-b475-113f643dbb32 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.187985 Jul 14 15:59:49.505661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 369/689] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:49.510493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.511467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.518102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.518563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.519408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.520423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.554421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ea1f7865-dcec-4385-8b83-684a334d26fd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047356 Jul 14 15:59:49.554966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 370/690] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:49.637413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.649319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-04277676-548b-441c-bd9a-cbeb8fbd15c9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.326363 Jul 14 15:59:49.653688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 321/691] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:50.109475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-4c20becc-c65d-47f4-b504-9ce7422744ef req-43e3400a-178a-464f-b1ff-20f395375161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1d5480-e5d1-4ed5-ba9d-185d99c20286", "tag": "24623b5e-2168-4725-aa9a-7cf93495ac58"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:50.119340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-4c20becc-c65d-47f4-b504-9ce7422744ef req-43e3400a-178a-464f-b1ff-20f395375161 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.120051 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-4c20becc-c65d-47f4-b504-9ce7422744ef req-43e3400a-178a-464f-b1ff-20f395375161 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.132924 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-4c20becc-c65d-47f4-b504-9ce7422744ef req-43e3400a-178a-464f-b1ff-20f395375161 service nova] Creating event network-changed:24623b5e-2168-4725-aa9a-7cf93495ac58 for instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 on hv-cinder-83716 Jul 14 15:59:50.143576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-4c20becc-c65d-47f4-b504-9ce7422744ef req-43e3400a-178a-464f-b1ff-20f395375161 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Jul 14 15:59:50.143576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 371/692] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:50.281850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.282661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.294322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.295319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.295805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.296393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.299496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.300241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.308059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.308555 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.309425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.310090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.447474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.455453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2124058b-ea50-4157-a836-71601b5538a3 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.179947 Jul 14 15:59:50.456064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 322/693] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:50.468743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.479331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a73b2015-0de6-4d10-bd91-773b461a4318 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.184265 Jul 14 15:59:50.479994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 372/694] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:50.526317 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.528854 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.533895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.534435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.535894 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.536407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.568219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.569360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.575662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.576088 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.576865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.577350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.609039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1f25d501-8c1b-433d-a74c-f6a671f1088f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Jul 14 15:59:50.609704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 373/695] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:59:50.668481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.669110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.671387 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:50.677519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.678030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.678901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.679353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.698191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.708104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-98913b22-a6fa-43ab-88e8-8235d1fdf609 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.185546 Jul 14 15:59:50.708104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 323/696] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:50.828194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.836885 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-174ec03e-7193-45a2-b13d-a2287c16a179 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.173249 Jul 14 15:59:50.837479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 374/697] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:51.476257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.476955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.479052 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:51.485325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.485783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.486607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.487056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.500106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.500749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.509493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.509974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.510754 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.511189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.662999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:51.667705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:51.672286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0dbcc14f-12a4-445b-bb78-dd6ba47893cf tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.177704 Jul 14 15:59:51.672880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 375/698] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:51.678663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.679419 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-64044368-fbaf-4066-8da3-3ac5182d9e81 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.205959 Jul 14 15:59:51.679640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.681176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 324/699] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:51.681568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:51.687654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.688172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.689110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.689706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.723476 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c94903f2-1035-4c6f-a84a-9cc10b47b10c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049508 Jul 14 15:59:51.724054 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 376/700] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:51.725568 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.726344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.733047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.733503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.734412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.734860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.854841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.855513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.861932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.862391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.863681 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.864140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.881744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:51.889970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-833aa615-c3e8-4c93-b702-6844a4b786d9 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.168364 Jul 14 15:59:51.890649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 325/701] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:52.001165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:52.009185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d1bc87f3-7918-4da6-a911-fa230dd5edea tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.158643 Jul 14 15:59:52.009805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 377/702] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:52.692673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.693491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.698530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.699148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.700312 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.700775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.701304 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=12 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:52.701933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.702282 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.706932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.708011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.714029 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.714029 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.875367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:52.875367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b4305f25-3930-4ca7-8319-56d57eaa86c8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.176424 Jul 14 15:59:52.875367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 326/703] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:52.875367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.875818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.880154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.880754 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.881555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.881804 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:52.882058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.890359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-24122c1a-9d20-47a6-931e-4bf7e226e7f9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.195523 Jul 14 15:59:52.890958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 378/704] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:52.907285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:52.908006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:52.915530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3216af15-14c2-4ed0-bb93-4624fe26e746 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048760 Jul 14 15:59:52.915722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.916120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 327/705] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:52.916330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.916968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:52.917411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.027564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:53.028220 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:53.034599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.035116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.035949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.036636 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.062313 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:53.071912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-321b1880-9df7-4241-a2d8-04a5e07184c4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.168393 Jul 14 15:59:53.072682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 379/706] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:52 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:53.175362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:53.183485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cb54ecb4-7b46-4b8e-a357-e3f1fb536f1c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.160305 Jul 14 15:59:53.184058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 328/707] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:53 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:53.883312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:53.883942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:53.891101 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.891552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.892508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.892947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.910449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:53.911086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:53.917545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=10 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:53.920232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.921155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.922512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.923124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.033695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.052915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-093d4bc3-5d27-4652-b908-954f278bb2b8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.174382 Jul 14 15:59:54.053717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 380/708] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:53 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:54.062915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:54.065068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:54.072146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.072602 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.079459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.079862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.080028 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.080187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:54.083776 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-52b11e94-fc09-4e93-bc4b-9b47b203d13e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.177887 Jul 14 15:59:54.089866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 329/709] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:53 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:54.090059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:54.090814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:54.097161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.097781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.098854 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.099624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.106144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-83475cdb-41de-4ff0-8fe7-c396bbf4e66c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050740 Jul 14 15:59:54.106292 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 381/710] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:54 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:54.200632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:54.201379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:54.207513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.207968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.208958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.209627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.241390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.250263 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9954a821-227f-45ee-9428-020d83466da0 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.164406 Jul 14 15:59:54.250941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 330/711] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:54 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:54.356930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.365062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1399642a-c3a3-4196-90cd-bbb664e5a007 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.168312 Jul 14 15:59:54.365635 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 382/712] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:54 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:55.070731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.071352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.077987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.078447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.079224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.079671 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.102752 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.103667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.113176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.113666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.114721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.115120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.227955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.236738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a7d42558-5f93-473e-bd6f-d8c226a42282 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.170507 Jul 14 15:59:55.237338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 331/713] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:55.242864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.243868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.250255 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.250710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.251486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.251925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.279035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.284641 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ebfc8399-8769-4941-916b-d02e79ae4fcd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046209 Jul 14 15:59:55.285317 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 332/714] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:55.287179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4cc2efb8-b3c0-4b4c-8c36-d56d624d531d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.189627 Jul 14 15:59:55.287992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 383/715] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:55.290203 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.290821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.297443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.297935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.298772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.299505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.385305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.385956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.393743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.394454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.395493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.396015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.439713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.448581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-badaac24-ace7-41df-b108-95418c6005f1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.162214 Jul 14 15:59:55.449272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 333/716] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:55.546640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.555549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f9e045ee-aec2-413d-a206-1c9375922170 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.176290 Jul 14 15:59:55.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 384/717] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:56.254818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.255738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.262316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.267229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.267229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.267229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.313122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.318797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.331435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.333258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.335010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.336096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.344725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:56.406813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f06bb11d-4948-4e81-a1ec-448d3ea8c573 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102703 Jul 14 15:59:56.409232 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 385/718] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:59:56.415972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.417350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.425056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.425781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.426625 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.427074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.504943 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.516355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-71627e25-bc97-4c64-b6ea-479b0b76f391 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.265193 Jul 14 15:59:56.517626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 334/719] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.524487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.525848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.533626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.534534 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.535579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.536367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.708372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.719054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-28201117-7508-4b7f-b9c1-912be479916a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.199936 Jul 14 15:59:56.719775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 335/720] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.728093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.728853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.738151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.739455 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.741146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.741716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.814141 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.822971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-882e07c6-fda0-437c-bffc-456ba55c7730 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.412155 Jul 14 15:59:56.823575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 386/721] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.828389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.828895 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.839469 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.843722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.843722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.843722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.894891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.902438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-62823bec-1dd3-4a32-bc34-ea369c6a0cf8 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.181495 Jul 14 15:59:56.903012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 336/722] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.940730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'services' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:57.224832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-00022e31-6c16-452e-9d9a-873c5df35e27 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "DELETE /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6/os-volume_attachments/bade9be3-7168-4680-9213-642b947ef8dd" status: 202 len: 0 microversion: 2.1 time: 0.399729 Jul 14 15:59:57.228906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 387/723] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 15:59:56 2022] DELETE /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6/os-volume_attachments/bade9be3-7168-4680-9213-642b947ef8dd => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:57.420710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.421930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.429131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.429596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.430470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.430914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.462676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7bc59755-fdaf-4fcd-98c9-5c2ba5f95498 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046048 Jul 14 15:59:57.463254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 337/724] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:57.528761 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.529462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.536898 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.537341 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.538127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.538563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.551351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.552048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.560280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.560280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.560280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.560551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.568506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:59:57.715283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.722954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-56e1af7f-9b64-4c05-88fd-014c70acffda tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.176339 Jul 14 15:59:57.723532 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 338/725] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:57.743594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.744250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.751124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.751721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.752562 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.753033 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.867990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8369c3ce-bedf-4d54-9c69-d55448ece71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 204 len: 0 microversion: 2.20 time: 0.342612 Jul 14 15:59:57.869285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 388/726] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 14 15:59:57 2022] DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 15:59:57.880272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.882924 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.889110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.889616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.890507 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.890942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.919406 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.929413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f8ae3a38-7922-463b-a279-c2f8e402723a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.191312 Jul 14 15:59:57.933984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 339/727] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:57.941767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.941767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.949459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.950109 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.950901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.951344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.053408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.074268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-188bffeb-7b65-42df-9ea3-0acd77cc9eb9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.191260 Jul 14 15:59:58.075970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 389/728] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:58.081260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:58.081988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:58.090570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.091287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.092334 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.092987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.138924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.148661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.150439 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.151551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0ce6b804-9f1d-43b0-87fd-4a0f71ffde65 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.216449 Jul 14 15:59:58.152179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 340/729] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:59:58.203725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-7b47411b-2f97-46a4-8115-53d394cbe6c5 req-9acb8f76-0d80-495e-b33d-447d8c41c2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bd946f-13d5-4770-902b-142bc1dfb76a", "name": "network-vif-plugged", "status": "completed", "tag": "571cdd06-9071-4e46-9c3b-2bddee54f4f9"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:58.215518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-7b47411b-2f97-46a4-8115-53d394cbe6c5 req-9acb8f76-0d80-495e-b33d-447d8c41c2c1 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.216878 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-7b47411b-2f97-46a4-8115-53d394cbe6c5 req-9acb8f76-0d80-495e-b33d-447d8c41c2c1 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.232759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-7b47411b-2f97-46a4-8115-53d394cbe6c5 req-9acb8f76-0d80-495e-b33d-447d8c41c2c1 service nova] Creating event network-vif-plugged:571cdd06-9071-4e46-9c3b-2bddee54f4f9 for instance 33bd946f-13d5-4770-902b-142bc1dfb76a on hv-cinder-83716 Jul 14 15:59:58.240125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-7b47411b-2f97-46a4-8115-53d394cbe6c5 req-9acb8f76-0d80-495e-b33d-447d8c41c2c1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041416 Jul 14 15:59:58.240847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 341/730] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:58.284834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.296853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1451583a-730b-44a0-b44b-73753627f003 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1277 microversion: 2.1 time: 0.219167 Jul 14 15:59:58.297883 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 390/731] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:58 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:58.742349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:58.743179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:58.749557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.750051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.750832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.751371 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.946954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:58.947672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:58.954815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.955287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.956068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.956538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.957607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.966907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-344c8ba1-ac2a-48bc-8eb3-be3a868ccaee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.229982 Jul 14 15:59:58.977247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 342/732] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:58 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:59.081156 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.081846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.088402 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.088851 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.089796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.089796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.096268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.104700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e12e5cce-e14f-46dd-83b3-5ed3a3916e97 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.161826 Jul 14 15:59:59.105392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 391/733] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:58 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:59.174403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.175193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.182283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.182740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.183554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.183992 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.228062 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.235744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-974496ab-0052-4618-972c-96dd90f8b103 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.158421 Jul 14 15:59:59.236576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 343/734] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:59.323226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.324079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.325446 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.330909 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.332134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.332134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.332544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.344065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.345721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.346966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-12765c88-c05d-4592-9dcb-455d1994e82c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.177500 Jul 14 15:59:59.349860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 392/735] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:59:59.489182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.497199 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0d2739e3-f189-4a74-82e9-bdefa8a378dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.180560 Jul 14 15:59:59.497787 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 344/736] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:59.987195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.992294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.996720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.997248 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.998206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.998747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.124617 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.125453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.135379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.136111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.137322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.137772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.159332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.168063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2b97a5f9-71d7-4234-bf00-82c80cec698d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.185778 Jul 14 16:00:00.169506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 393/737] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:00.254490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.255180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.262109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.262487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.263323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.263735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.444907 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.454478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e7422899-0db3-40d2-a3a1-d0d711bb940d tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1678 microversion: 2.1 time: 0.204903 Jul 14 16:00:00.465853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 394/738] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:00.472056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.486731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.487505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.488483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e671d62d-5a7c-4ebf-9ba0-0d74df21cf23 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.368581 Jul 14 16:00:00.492281 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 345/739] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:00.500339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.500849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.503269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.504246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.511987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.511987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.523712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.524161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.524956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.525400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.605884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:00.605884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:00.658582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.669252 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.670883 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.672283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fe67de9f-7fcd-43e7-a731-e551a41b8b54 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1720 microversion: 2.20 time: 0.215632 Jul 14 16:00:00.672983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 395/740] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:00.678828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.679496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.686123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.686524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.687363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.687831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.855910 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.869340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-30884a28-c759-4920-a304-ef0b9cd33ead tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.195216 Jul 14 16:00:00.870069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 396/741] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:00.984504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e65bbd37-3b2c-48d8-a74b-0fa185d76793 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "DELETE /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 204 len: 0 microversion: 2.1 time: 0.490345 Jul 14 16:00:00.985536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 346/742] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:00 2022] DELETE /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:00:01.003362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:01.004172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.012379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.012949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.015350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.015807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.191986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.198179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:01.198179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.204618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.206471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.206471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.206471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.207046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-496182a1-6350-4275-b101-b1c6156849fb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1512 microversion: 2.1 time: 0.216033 Jul 14 16:00:01.207751 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 397/743] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:01.438900 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.447260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d101759e-d11c-41b4-940b-981ce454feb8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.255149 Jul 14 16:00:01.447947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 347/744] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:01 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:01.486667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:01.487525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.495196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.495660 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.496498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.496931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.509099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:01.510093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.521156 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.525277 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.528569 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.538008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.760361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.771470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-07b0c9ff-ece0-44d2-8814-4f129247140c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1655 microversion: 2.1 time: 0.294411 Jul 14 16:00:01.786189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 398/745] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:01 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1655 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:01.786189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:01.786189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:01.797672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.798215 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.799330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.799699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.827332 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:01.882855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.892378 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.892856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:01.894106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7271e918-abe3-4e24-9fb6-64cb2b2af5aa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1652 microversion: 2.20 time: 0.120201 Jul 14 16:00:01.907061 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 399/746] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:01 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1652 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:01.912306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-371afa0c-328a-41ee-9712-8cdc194c94ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:01.918568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-371afa0c-328a-41ee-9712-8cdc194c94ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:01.919056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-371afa0c-328a-41ee-9712-8cdc194c94ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:01.950091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-371afa0c-328a-41ee-9712-8cdc194c94ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Going to try to start instance {{(pid=129992) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 16:00:01.999930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.009618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ba58d869-50db-4bc1-8d33-38dc08937a9b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.504556 Jul 14 16:00:02.010323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 348/747] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:01 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.015075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.015759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.023155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.023942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.024790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.025301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.168485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.171414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-371afa0c-328a-41ee-9712-8cdc194c94ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action" status: 202 len: 0 microversion: 2.1 time: 0.264393 Jul 14 16:00:02.172408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 400/748] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:00:01 2022] POST /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:02.179114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-a119c0f6-02df-4e87-83b5-e1c20f8bf5b5 req-8a781070-b0cc-416c-9611-c3f7bfd1b981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2205b6-6161-416f-9364-c7110a590b66", "name": "network-vif-deleted", "tag": "fd529ef3-8f15-4ade-8ac4-bdba638dad4c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:02.182280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c3105fe9-152e-4d02-8665-a8cc73610803 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.170869 Jul 14 16:00:02.183772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 349/749] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:02 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.188959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a119c0f6-02df-4e87-83b5-e1c20f8bf5b5 req-8a781070-b0cc-416c-9611-c3f7bfd1b981 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.189481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a119c0f6-02df-4e87-83b5-e1c20f8bf5b5 req-8a781070-b0cc-416c-9611-c3f7bfd1b981 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.190200 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.191063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.198718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.199999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.200971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.201653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.203612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-a119c0f6-02df-4e87-83b5-e1c20f8bf5b5 req-8a781070-b0cc-416c-9611-c3f7bfd1b981 service nova] Creating event network-vif-deleted:fd529ef3-8f15-4ade-8ac4-bdba638dad4c for instance fa2205b6-6161-416f-9364-c7110a590b66 on hv-cinder-83716 Jul 14 16:00:02.208933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-a119c0f6-02df-4e87-83b5-e1c20f8bf5b5 req-8a781070-b0cc-416c-9611-c3f7bfd1b981 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Jul 14 16:00:02.209555 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 401/750] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:02.228306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.229014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.235382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.236089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.236905 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.237347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.359457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.369321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-acb7b77d-c1fe-4c66-884e-f34824132e7b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.183496 Jul 14 16:00:02.370662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 350/751] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:02 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.402833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.412463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a8bda0c0-a8ed-403b-bc6e-5f22cf94c42b tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1512 microversion: 2.1 time: 0.187962 Jul 14 16:00:02.412463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 402/752] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:02 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.474382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.475704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.478784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:02.492866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.493400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.494271 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.495308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.646249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.653594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0b11fb2e-98c4-4f75-8bc1-9a2c7ae3d656 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.186731 Jul 14 16:00:02.654206 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 351/753] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:02 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.912729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.913606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.921379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.921910 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.922743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.923184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.005429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.014472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.016006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.017151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-009b2d2e-7461-455a-ab63-4de3ef24dd07 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1364 microversion: 2.20 time: 0.108514 Jul 14 16:00:03.017719 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 403/754] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:02 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1364 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:03.032548 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.036226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.042986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.043782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.045524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.046139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.202957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.203971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.211614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.212624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.213990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.214503 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.278040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.287332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1f0cf584-1f84-43b7-b781-3a2527935a31 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.259555 Jul 14 16:00:03.296570 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 352/755] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:03.371237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.380564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cffdd574-e042-44c0-827f-3a40c22ce431 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.182422 Jul 14 16:00:03.381444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 404/756] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:03.387956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.388578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.395698 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.396265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.397071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.397525 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.429293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.429932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.436515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.436968 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.437745 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.438212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.536492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.546583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-de72c291-9ec2-42d7-846b-b246894ef7ba tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.162436 Jul 14 16:00:03.547655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 353/757] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:03.577121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.585479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2d1cb79c-1302-4c5c-909f-d53dc19a72be tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1512 microversion: 2.1 time: 0.160555 Jul 14 16:00:03.586094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 405/758] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:03.671448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.672257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.678733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.679185 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.679960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.680460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.994414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.002323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-82525bb3-930c-474c-be62-80f696b52284 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1368 microversion: 2.1 time: 0.335521 Jul 14 16:00:04.002915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 354/759] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:04.036205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.036946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.044142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.044923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.045840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.046455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.079989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.080356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.080818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:04.122247 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.132612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.134173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.135363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a03e4e32-25ac-47d0-b1f1-ebfc4b5a43c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.103248 Jul 14 16:00:04.135932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 406/760] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:04.305507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.319103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.319103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.319103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.319103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.319865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.399538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.400323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.408932 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.409408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.410194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.410631 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.506686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.515201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d1ca671b-7223-406d-aa74-3910fc446705 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.213716 Jul 14 16:00:04.515790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 355/761] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:04.520950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-213ceef1-6592-4a88-93b6-3a0e5e9ef311 req-2c9881d0-e71b-4ae5-86c8-eb8a4a32f598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619c1920-2cc9-4d28-97f0-71d28cc768f6", "name": "network-vif-deleted", "tag": "85cd0e82-ac8a-403f-a673-808c61927e38"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:04.530023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-213ceef1-6592-4a88-93b6-3a0e5e9ef311 req-2c9881d0-e71b-4ae5-86c8-eb8a4a32f598 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.530472 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-213ceef1-6592-4a88-93b6-3a0e5e9ef311 req-2c9881d0-e71b-4ae5-86c8-eb8a4a32f598 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.542540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-213ceef1-6592-4a88-93b6-3a0e5e9ef311 req-2c9881d0-e71b-4ae5-86c8-eb8a4a32f598 service nova] Creating event network-vif-deleted:85cd0e82-ac8a-403f-a673-808c61927e38 for instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 on hv-cinder-83716 Jul 14 16:00:04.547672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-213ceef1-6592-4a88-93b6-3a0e5e9ef311 req-2c9881d0-e71b-4ae5-86c8-eb8a4a32f598 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 Jul 14 16:00:04.548279 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 356/762] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:04.565193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.565673 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.565937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.572628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.573080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.573893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.574218 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7ecf30b1-65f1-405d-a7eb-59932c3277a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.179514 Jul 14 16:00:04.574352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.574950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 407/763] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:04.603201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.603781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.610454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.610906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.611689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.612130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.683376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.693622 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-96b8d5ae-a2ff-4fd7-b453-5595f188d0f5 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1470 microversion: 2.1 time: 0.094176 Jul 14 16:00:04.695425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 408/764] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1470 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:04.719669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.729470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5b1b3c3e-fdd1-479e-85b4-1f5d98492336 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.168587 Jul 14 16:00:04.739606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 357/765] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:05.023777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.024893 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.033237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.033687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.035528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.036227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.155149 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.155871 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.164130 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.164672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.165528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.166066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.193224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.200462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.200905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.201180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7ebb9db5-12f9-4f3c-8b04-ecf6d1e4d25b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1558 microversion: 2.1 time: 0.185137 Jul 14 16:00:05.201386 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:05.201781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 409/766] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:05.218165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.218727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.225957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.226413 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.227204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.227644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.246628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.255622 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.257260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.258433 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fd4a1476-3662-4d54-921a-2f5385ef2e50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.107442 Jul 14 16:00:05.258999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 358/767] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:00:05.318916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1360b0c3-44e6-4257-88fc-3ff1f058eb6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104584 Jul 14 16:00:05.319509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 410/768] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:05.533217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.534004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.540866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.541407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.542277 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.542808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.592850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.593569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.600493 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.601036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.610707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.610707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.686906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.696543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2a4d54e0-3a2f-4687-bab6-a7362021c5c5 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.166732 Jul 14 16:00:05.696543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 359/769] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:05.712002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.712618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.718772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.719229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.720006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.720450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.752545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.752998 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.753447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:05.798365 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.807721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-decbd5d9-b0db-4a26-ab88-de5f05f48ccc tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.099577 Jul 14 16:00:05.808377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 360/770] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:05.867103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.874637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a664935b-0d6b-4e1a-b372-7fb0344c722b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.285764 Jul 14 16:00:05.875420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 411/771] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:05.941728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.942397 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.948847 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.949328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.950142 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.950580 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.092195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.101183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a982b312-0a75-4815-8c0b-5714394ea37c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.291743 Jul 14 16:00:06.101985 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 361/772] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:06.277227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.277873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.284237 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.284694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.285475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.286047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.321529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.322012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.322497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:06.412440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.421514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.423269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.424543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-119c4e33-36ef-4edb-8850-2511e60ee818 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.151641 Jul 14 16:00:06.425462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 412/773] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:06.695153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-5d88f0bc-4e18-4652-a94c-43c0cfa9a978 req-71725071-c33e-4639-b7ad-c6a8676169d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bd946f-13d5-4770-902b-142bc1dfb76a", "tag": "571cdd06-9071-4e46-9c3b-2bddee54f4f9"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:06.704047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-5d88f0bc-4e18-4652-a94c-43c0cfa9a978 req-71725071-c33e-4639-b7ad-c6a8676169d7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.704491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-5d88f0bc-4e18-4652-a94c-43c0cfa9a978 req-71725071-c33e-4639-b7ad-c6a8676169d7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.709136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:06.715006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.715726 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.718116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-5d88f0bc-4e18-4652-a94c-43c0cfa9a978 req-71725071-c33e-4639-b7ad-c6a8676169d7 service nova] Creating event network-changed:571cdd06-9071-4e46-9c3b-2bddee54f4f9 for instance 33bd946f-13d5-4770-902b-142bc1dfb76a on hv-cinder-83716 Jul 14 16:00:06.722132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.723276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.723941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-5d88f0bc-4e18-4652-a94c-43c0cfa9a978 req-71725071-c33e-4639-b7ad-c6a8676169d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033582 Jul 14 16:00:06.724121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.724502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.726034 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 362/774] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:06.827242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.827955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.835916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.836971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.837141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.837768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.865902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.872844 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.873200 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.873657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:06.874936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8e9aa6f0-8dcf-431c-b668-8f0c88f75944 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.163871 Jul 14 16:00:06.875521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 413/775] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:06.903092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.904020 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.910621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.911080 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.911870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.912309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.926903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.935642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-438278ce-9e74-4cdc-ad43-b575def24ecd tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.113367 Jul 14 16:00:06.936233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 363/776] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.060255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.073006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cc20a339-1ca7-4d98-afd7-68ac4a7099c6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.173948 Jul 14 16:00:07.073692 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 414/777] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.119151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.119864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.126329 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.126783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.127630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.128159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.275692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.283335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2e9b9d49-fa05-4cde-a3a4-682c26d1bb12 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.168066 Jul 14 16:00:07.283922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 364/778] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.444816 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.445478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.451623 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.452073 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.452915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.453356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.469626 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:07.488940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.489395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.489906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:07.545065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.554884 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.556481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.558399 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-19deb2d8-c7f0-4a77-bc73-4eb5d361d43a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.118396 Jul 14 16:00:07.558584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 415/779] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:07.898172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.899080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.905661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.906148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.906921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.907361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.958756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.960086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.967633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.968094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.968896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.969325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.006784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.007329 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.007836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:08.054049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.062096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-96d7095f-723c-41a5-9589-35a178fb67d3 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.107257 Jul 14 16:00:08.062690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 416/780] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:08.062868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.071697 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5412cd7c-aa33-47af-ba44-d7743cc2e4a4 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.177633 Jul 14 16:00:08.072418 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 365/781] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:08.090544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.091163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.093034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:08.099118 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.099118 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.099852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.100295 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.237547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.245263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-36eaf7dd-083a-4819-9004-1f5a2ed2cca6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.158707 Jul 14 16:00:08.245939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 417/782] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:08.301302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.301939 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.308175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.308625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.309405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.309866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.447761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.456371 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ab396962-e784-4fdf-bb05-681b97d79927 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.158910 Jul 14 16:00:08.457901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 366/783] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:08.576810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.577431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.585030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.585477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.586296 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.586737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.619452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.619899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.620906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:08.664012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.672327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.674131 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.675298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e4b30b98-b7c8-41da-9037-f008c8f86010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.102562 Jul 14 16:00:08.675876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 418/784] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:09.079759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.079759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.087000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.087457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.088239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.088676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.090347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.091044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.098287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.098740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.099581 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.100021 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.132559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.133028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.133480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:09.178223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.185928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cc5f954e-69f3-4106-8726-2e706ecdff98 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.110883 Jul 14 16:00:09.186905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 367/785] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.242181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.250580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e9cf099c-3cab-450a-9375-b30592fc9e21 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.164568 Jul 14 16:00:09.251162 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 419/786] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.261863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.262573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.268779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.269231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.270037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.270481 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.412372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.421589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3b04a884-a92d-4238-a9c9-4892d65dd9db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.162683 Jul 14 16:00:09.421589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 368/787] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.480944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.481550 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.487605 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.488712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.489751 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.490040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.623529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.631121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8295b257-40be-41a9-8e68-b835b930f6c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.154114 Jul 14 16:00:09.631690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 420/788] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.692695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.693324 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.699440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.699896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.700665 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.701104 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.734364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.734824 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.735282 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:09.778872 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.788129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.789676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.790879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d4b207b0-bf19-4040-8afa-b33bf6f449f0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.102205 Jul 14 16:00:09.791448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 369/789] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:10.202894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.203513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.211106 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.211565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.212389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.212817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.246213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.246665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.247124 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:10.270740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.271772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.279655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.280273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.281216 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.281810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.291682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.300410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-649b60e9-7cdb-4357-ac93-1cabb8e42979 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.100908 Jul 14 16:00:10.303097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 421/790] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.420205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.428651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2795a605-61f7-4186-98da-78f9d657b77d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.164119 Jul 14 16:00:10.429241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 370/791] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.439171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.439784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.446526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.446976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.447737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.448180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.589142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.597164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7c1a4738-fa85-4004-94f9-434b070556d4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.161881 Jul 14 16:00:10.598395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 422/792] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.648507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.649128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.659281 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.660272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.661065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.661564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.797494 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.807727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-972fd029-d0a1-4548-a142-5ddf832d3dac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.163085 Jul 14 16:00:10.808307 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 371/793] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.811483 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.812140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.818402 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.818877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.819641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.820156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.853606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.854081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.854534 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:10.896359 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.904607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.906154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.907316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b7c63e62-13ef-4dec-b6b8-e967045e908a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.102435 Jul 14 16:00:10.907876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 423/794] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:00:11.316881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.317429 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.324330 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.324805 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.325605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.326089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.361507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.362234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.366431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:11.412067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.419948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5c1dd424-ab60-48b2-ad88-ad1e7a32ff80 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.107086 Jul 14 16:00:11.420536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 372/795] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:11.446814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.447444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.454246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.454707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.455481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.456074 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.601230 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.609791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3ce5d0d3-ec2c-4aaf-8c71-9b0709518394 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.166991 Jul 14 16:00:11.612214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 424/796] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:11.616635 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.617243 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.623475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.623906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.624676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.625103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.765505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.774166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-030b80c3-6814-4256-8923-1c2bc88c7911 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.161973 Jul 14 16:00:11.774810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 373/797] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:11.825376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.826032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.834659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.835113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.835887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.836322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.925830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.926452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.932800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.933695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.942766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.942766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.973271 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.974180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.974180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:11.981488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.989930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d33a6600-30dc-4bef-b69e-1bfb85351521 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.168432 Jul 14 16:00:11.990630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 425/798] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.020807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.029326 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.030874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.036051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9df03cac-f208-4c3c-9596-8657b43481bd tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.110739 Jul 14 16:00:12.036051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 374/799] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:00:12.437795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.438354 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.445185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.445629 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.446426 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.446858 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.485033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.485481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.485954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:12.529847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.538196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cabedfbe-ad9f-490f-97b7-56b79b3f035e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.104047 Jul 14 16:00:12.538830 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 426/800] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.629507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.630316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.637888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.638366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.639190 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.639632 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.785175 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.790782 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.791422 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.793598 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d2e1fb7d-c711-4e46-b4d7-8123b3996323 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.168854 Jul 14 16:00:12.794229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 375/801] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.799497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.800184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.805357 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.805357 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.946143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.953731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5e4971db-6380-4c9a-8cd1-e99e704a2f38 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.167110 Jul 14 16:00:12.954339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 427/802] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:13.007578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.008125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.015793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.016238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.017162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.017599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.053035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.053646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.059757 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.060207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.061164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.061604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.096085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.096540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.096998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:13.149339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.157741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.159305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.161773 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0c4e27bb-501c-4d8e-849f-c9394b99911d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.112815 Jul 14 16:00:13.168189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.169881 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 428/803] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:00:13.176932 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-38f9176b-4561-463d-a437-3844cd13e29a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.173324 Jul 14 16:00:13.177500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 376/804] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:13.556491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.557097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.564128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.564571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.565348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.565770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.598476 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.598917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.599365 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:13.601087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:13.642522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.650748 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d973a5ed-ab5d-492f-8819-13eae7661aec tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.098166 Jul 14 16:00:13.651331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 429/805] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:13.812139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.812795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.819913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.820302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.821092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.821536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.971717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.972998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.979674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.980132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.981395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.982091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.985953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.991209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:13.996457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7b13c137-94fb-4034-a3c0-6e92f4efd827 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.188189 Jul 14 16:00:13.997080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 377/806] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.136727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.147017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5ccbf1cc-fd4d-4065-8e7f-4838e378bc5a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.179008 Jul 14 16:00:14.147518 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 430/807] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:14.180106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.188004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.188004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.188004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.188464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.188989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.194592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.195334 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.201675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.202176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.203001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.203444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.224791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.225234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.225678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:14.267621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.278479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.280084 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.282058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4ba174d6-7689-45a8-85b7-d62862d21d04 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.106195 Jul 14 16:00:14.291440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 378/808] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:14.344539 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.353984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e5cc0167-fae4-4026-9231-b29889a203c9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.163967 Jul 14 16:00:14.354577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 431/809] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:14.666944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.667563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.674700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.675165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.676475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.676912 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.708455 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.708903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.709353 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:14.785520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.796348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e50dbd38-3786-41e9-ae9e-c33169d6c219 tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.133178 Jul 14 16:00:14.797632 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 379/810] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:15.014808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.015565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.022314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.022775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.023545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.023986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.168395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.169186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.175368 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.177756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.178362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.179563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.180079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.184513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1d08cafd-40aa-4bda-a183-2826f137a434 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.173500 Jul 14 16:00:15.185112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 432/811] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:15.306336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.307058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.313495 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.313983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.314789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.315223 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.347870 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.350472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.351229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.351903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'fault' on Instance uuid fa2205b6-6161-416f-9364-c7110a590b66 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:15.357670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2e5c90b2-e3a5-4352-b62c-dcb8cca17484 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.193219 Jul 14 16:00:15.361873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 380/812] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:15.374521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.375245 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.383194 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.383659 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.384470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.385200 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.408902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.419278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.421191 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.422620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c0222d3a-8abd-4cdd-8c20-1635ace0f4ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 200 len: 1369 microversion: 2.20 time: 0.120101 Jul 14 16:00:15.428591 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 433/813] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 1369 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:15.632613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.641999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-139aeddb-83a1-486a-b6dd-13d6b55b0284 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.271310 Jul 14 16:00:15.642816 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 381/814] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:15.814217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.814818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.821099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.821547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.822331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.822841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.855160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.855608 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.856054 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:15.898310 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:15.906303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7a77b7bb-5cd4-4019-bab0-8b9c45fa08eb tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.095821 Jul 14 16:00:15.906887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 434/815] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.204604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.205217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.212499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.212952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.213717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.214219 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.379583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.380442 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.387470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.388098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.388981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.389532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.473519 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.480071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-51223817-c3c4-4931-9e84-225a81f65f36 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.279386 Jul 14 16:00:16.481017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 382/816] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.485942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.486687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.493897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.495094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.495534 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.510280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 HTTP/1.1 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:00:16.512014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:00:16.513701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'fa2205b6-6161-416f-9364-c7110a590b66'} Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:16.514629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:00:16.517196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:16.519924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:16.519924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1438e9dc-f601-4272-b4a7-ebecddcd52e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 404 len: 111 microversion: 2.20 time: 0.034435 Jul 14 16:00:16.520204 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 383/817] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:00:16.528422 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-68e3e759-8ab9-4b0e-ac38-d4068c51feec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '.version_select at 0x7f33ff6bd3a0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.555452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.563254 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0a432693-36e2-4815-87a0-cb76c4776294 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.189551 Jul 14 16:00:16.563832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 435/818] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.642367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-68e3e759-8ab9-4b0e-ac38-d4068c51feec tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113778405" status: 204 len: 0 microversion: 2.20 time: 0.118753 Jul 14 16:00:16.643082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 384/819] 10.222.0.47 () {60 vars in 1258 bytes} [Thu Jul 14 16:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113778405 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 16:00:16.659703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.660570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.667537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.667989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.668815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.669350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.878058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.887270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b0d126ce-5b80-4650-a92e-44181863c93a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.231604 Jul 14 16:00:16.888604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 436/820] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.925213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.926999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.935121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.935604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.936427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.937313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.973866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.973866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.973866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lazy-loading 'fault' on Instance uuid 619c1920-2cc9-4d28-97f0-71d28cc768f6 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:17.025053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcab272d7946c69aac92f6d3030942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16ae801ca124180b78f2fce16acc4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:17.033416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-31042071-1b99-448c-855f-a7aebf33c11e tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 200 len: 1308 microversion: 2.1 time: 0.113521 Jul 14 16:00:17.037967 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 385/821] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:17.580645 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.582087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.595067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.595067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.595067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.595067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.772535 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.773123 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:17.773249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.780016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.783450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.783614 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-063df554-cf29-4268-a5e0-284fe1ac4f60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.204875 Jul 14 16:00:17.783749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.783867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 386/822] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:17.783985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.788744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5d0a05ee-cd47-4138-9531-dd0510e8988a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: .version_select at 0x7f33ff70a280>, body: {"keypair": {"name": "tempest-keypair-966752956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1oKE47O9SyHD+2a1S4im9SjWhSZo0hrPGGuXj9rJJO6lxwxHwImpHHiGQbFDN85xttTVB1GBB9+/Bk9oxCLNLETJLgtyeuvJM/V8QKM5vx59Z24C4qSktNHpfbpSnDhw=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:17.805638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-5d0a05ee-cd47-4138-9531-dd0510e8988a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:00:17.810506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-5d0a05ee-cd47-4138-9531-dd0510e8988a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for user 95c6d7130d6c4ae4b8460807e6820ef1 and project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:00:17.815327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:17.897044 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5d0a05ee-cd47-4138-9531-dd0510e8988a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.114006 Jul 14 16:00:17.898002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 387/823] 10.222.0.47 () {62 vars in 1199 bytes} [Thu Jul 14 16:00:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 16:00:17.905035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.905653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.913086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.913780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.914648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.915083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.942494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:17.951079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7bf40736-7561-43ac-9d17-a7e5b78137f3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1736 microversion: 2.1 time: 0.457746 Jul 14 16:00:17.951664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 437/824] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1736 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:18.052169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.052815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] [instance: 619c1920-2cc9-4d28-97f0-71d28cc768f6] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.059403 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.067674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.067674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.067674 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.078309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] HTTP exception thrown: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Request method failure captured: Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 HTTP/1.1 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DzXp1gIY5Z6cm7rYaICK1qAYBMOX6fB50EeSa2fW5-K6Dv7XB-Y3727SRub72TflGMuxk5UZUuUo3gyPhj1VKLR9ALrWyEUvhnrgkag7DmYHVtguHCm4cR_5xSitW7WLk8nUKpn-Or6TWrRegsLDo0b4G3UPUlXPnhTELdIKTm7Mn8 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: d16ae801ca124180b78f2fce16acc4f7 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:00:18.079974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16ae801ca124180b78f2fce16acc4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d16ae801ca124180b78f2fce16acc4f7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16ae801ca124180b78f2fce16acc4f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d16ae801ca124180b78f2fce16acc4f7"}]}] Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: d16ae801ca124180b78f2fce16acc4f7 Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-15214121 Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesSnapshotTestJSON-15214121-project Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 54fcab272d7946c69aac92f6d3030942 Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesSnapshotTestJSON-15214121-project Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. Jul 14 16:00:18.081390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '619c1920-2cc9-4d28-97f0-71d28cc768f6'} Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:18.083083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. Jul 14 16:00:18.084453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:00:18.085601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] Returning 404 to user: Instance 619c1920-2cc9-4d28-97f0-71d28cc768f6 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:18.085601 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6bb9244f-3200-4bc4-aee2-c2865c20055a tempest-VolumesSnapshotTestJSON-15214121 tempest-VolumesSnapshotTestJSON-15214121-project] 10.222.0.47 "GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6" status: 404 len: 111 microversion: 2.1 time: 0.033637 Jul 14 16:00:18.086200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 438/825] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/619c1920-2cc9-4d28-97f0-71d28cc768f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:18.087313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:18.106647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f53e07c5-5571-4bda-a73b-bbce5ea70928 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1664 microversion: 2.1 time: 0.205829 Jul 14 16:00:18.116216 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 388/826] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:18.802136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.803002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.813974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.814434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.815244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.815667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.969373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.970159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.978168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.978762 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.979779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.980443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.997734 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.008496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-21b3f327-7663-45c0-8e95-1dbacafe3f7e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.211482 Jul 14 16:00:19.010164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 439/827] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:19.123638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.124266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.132768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.133323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.134366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.141665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.144574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.153235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0d29262f-7ed3-4ea2-ab0b-a0b21dac3587 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1716 microversion: 2.1 time: 0.188234 Jul 14 16:00:19.153740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 389/828] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1716 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:19.213209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.221688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.221688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.221688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.221688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.222692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.322857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] HTTP exception thrown: Cannot 'detach_volume' instance 55564827-8025-4413-832b-e84ef63d1b01 while it is in vm_state rescued Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Request method failure captured: Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments/0a15b5ba-fcdd-4b08-b2f7-f53fb703e019 HTTP/1.1 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxhUXoajOhh3ceVHksOZo9mrBJutckJmhJIeA0AAOAqzhvwYY2Oa7aqCfQvOPi1CHYnXizlJsZjgFaYJ72iXNuHRDRUdJA1kkOeNxnEy1tBVSXiCs4AqVdH1hg9qJlEgV5sF3QgMH7PhkOWWJ-QiJoqNH4nUPM3oQ20nXWLayZ5EEg Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:00:19.324841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_508fd5c51f544a3db6d0b87e37750e01", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/508fd5c51f544a3db6d0b87e37750e01"}]}] Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 81ca45714ee44a549fd002b4aa13973b Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:00:19.326597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Cannot 'detach_volume' instance 55564827-8025-4413-832b-e84ef63d1b01 while it is in vm_state rescued Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'server_id': '55564827-8025-4413-832b-e84ef63d1b01', 'id': '0a15b5ba-fcdd-4b08-b2f7-f53fb703e019'} Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 55564827-8025-4413-832b-e84ef63d1b01 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:19.327704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 55564827-8025-4413-832b-e84ef63d1b01 while it is in vm_state rescued Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 55564827-8025-4413-832b-e84ef63d1b01 while it is in vm_state rescued Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:00:19.329177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Returning 409 to user: Cannot 'detach_volume' instance 55564827-8025-4413-832b-e84ef63d1b01 while it is in vm_state rescued {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:19.330579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1cd117fb-4ab3-4819-8da6-445026bb19a7 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments/0a15b5ba-fcdd-4b08-b2f7-f53fb703e019" status: 409 len: 152 microversion: 2.1 time: 0.116796 Jul 14 16:00:19.330579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 390/829] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:19 2022] DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments/0a15b5ba-fcdd-4b08-b2f7-f53fb703e019 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 16:00:19.330758 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.336051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:19.336698 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.338901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c277f228-45f5-4de0-8195-48f82203534a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1668 microversion: 2.1 time: 0.219194 Jul 14 16:00:19.339793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 440/830] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:19.342801 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.343252 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.344022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.344458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.599673 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-948c75bb-19a6-422b-97a1-f7df63ab2b62 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/action" status: 202 len: 0 microversion: 2.1 time: 0.267883 Jul 14 16:00:19.600727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 391/831] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:00:19 2022] POST /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:19.608728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.609339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.616075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.616524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.617285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.617714 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.753183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.768876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e9fe7886-6d77-4193-a836-2782e22ff8b6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1724 microversion: 2.1 time: 0.164035 Jul 14 16:00:19.769685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 441/832] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:20.030082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.033649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.049627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.052347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.054131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.054996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.246537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-9c82404d-f130-49b5-9585-bfb640dfa5db req-43a72d81-2ddd-40d0-afee-b27461d56c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1d5480-e5d1-4ed5-ba9d-185d99c20286", "name": "network-vif-plugged", "status": "completed", "tag": "24623b5e-2168-4725-aa9a-7cf93495ac58"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:20.256936 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-9c82404d-f130-49b5-9585-bfb640dfa5db req-43a72d81-2ddd-40d0-afee-b27461d56c39 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.257389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-9c82404d-f130-49b5-9585-bfb640dfa5db req-43a72d81-2ddd-40d0-afee-b27461d56c39 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.269556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-9c82404d-f130-49b5-9585-bfb640dfa5db req-43a72d81-2ddd-40d0-afee-b27461d56c39 service nova] Creating event network-vif-plugged:24623b5e-2168-4725-aa9a-7cf93495ac58 for instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 on hv-cinder-83716 Jul 14 16:00:20.275104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-9c82404d-f130-49b5-9585-bfb640dfa5db req-43a72d81-2ddd-40d0-afee-b27461d56c39 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 Jul 14 16:00:20.275940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 442/833] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:20.276333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:20.285440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-06ddd346-82d6-4b1c-bef0-5c19231550dc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.262200 Jul 14 16:00:20.286094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 392/834] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:20.788526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.789231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.795930 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.796379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.797160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.797598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.975042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:20.983164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f0167754-0e5d-4fce-b758-bf9b8faccbe6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1724 microversion: 2.1 time: 0.199795 Jul 14 16:00:20.983729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 443/835] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:21.225533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-969291355", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323899ca-9d2f-48f4-8d8a-7de26106abb9"}], "security_groups": [{"name": "tempest-securitygroup--481847684"}], "key_name": "tempest-keypair-966752956", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:21.303366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.303894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.310474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.311099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.311835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.312274 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.327464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] validate_networks() for [('323899ca-9d2f-48f4-8d8a-7de26106abb9', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:00:21.455114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:21.466214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b32d901a-98fd-4122-a239-d25dba7f779a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.167865 Jul 14 16:00:21.466902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 444/836] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:21.812980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:00:21.813409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:00:21.814025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:00:21.817530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:00:21.817530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:00:21.824066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.824513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.825306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.825737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.843572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:00:21.851887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Getting quotas for user 95c6d7130d6c4ae4b8460807e6820ef1 and project 6c247c5f4fb74c78baaf3f4a63a04e42. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:00:21.859785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:00:21.862091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:00:22.001321 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.001954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.008351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.008802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.009580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.010030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.021353 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4773fabf-36c5-4b7c-a7d8-fe08b3ec3838 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.860318 Jul 14 16:00:22.022398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 393/837] 10.222.0.47 () {62 vars in 1187 bytes} [Thu Jul 14 16:00:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 16:00:22.033006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.033624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.101689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.110187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.112143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.114151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-733f3aa4-2429-41f2-9c16-4c945843709a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1280 microversion: 2.20 time: 0.085124 Jul 14 16:00:22.114650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 394/838] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:22.158802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.167727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2a5399ce-8a4b-43d6-b039-f86678817ee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1724 microversion: 2.1 time: 0.170556 Jul 14 16:00:22.168345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 445/839] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:22.483775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.484555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.491500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.491955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.492731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.493163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.641921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.650537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-98dd140b-db79-48cd-a8a9-029aa304fb3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.170647 Jul 14 16:00:22.651146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 395/840] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:23.132355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.132963 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.139728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.140178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.140983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.141415 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.185661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.186303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.194810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.195278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.196068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.196515 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.203366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.205895 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:23.213682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.215259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.216363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3d784e35-d0a3-4138-9daa-be8181968156 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1284 microversion: 2.20 time: 0.088598 Jul 14 16:00:23.216956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 446/841] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:23.327676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.331279 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:23.336697 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aba1cc33-502e-42ca-af34-64aebbd4b112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1724 microversion: 2.1 time: 0.154892 Jul 14 16:00:23.337266 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 396/842] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:23.667923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.668538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.676434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.676887 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.677659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.678140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.817366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.825239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bffbd989-fc9c-4468-8816-ae7c0526d366 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.161144 Jul 14 16:00:23.826104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 447/843] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:24.235432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.236049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.244081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.244524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.245312 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.245751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.310464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.319613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.321181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.322373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-89a8697f-8a7c-4da1-a924-249eaebf01bc tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1284 microversion: 2.20 time: 0.091293 Jul 14 16:00:24.322944 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 397/844] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:24.369650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.370341 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.377070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.377520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.378851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.379293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.513005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.521760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e7d5e05d-4e59-4ef9-9b3a-77d4820efb2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1724 microversion: 2.1 time: 0.156029 Jul 14 16:00:24.522375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 448/845] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:24.843739 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.844347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.850815 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.851320 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.852093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.852623 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.000700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.009006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-469c8453-8b3c-4cc3-93ca-e14a63f6a50a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.169127 Jul 14 16:00:25.009578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 398/846] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:25.343431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.344151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.351897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.352354 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.353138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.353576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.420300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.430963 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.435225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.435225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b8d3a2f1-d8ee-4899-8a59-5baef824267f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1284 microversion: 2.20 time: 0.095973 Jul 14 16:00:25.435225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 449/847] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:25.540868 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.541493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.548454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.549344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.550327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.550508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.882112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.882112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-22e9f988-03a9-4a38-acdd-6d693a87e16c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1730 microversion: 2.1 time: 0.340980 Jul 14 16:00:25.882112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 399/848] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:25.897588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.898169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.905304 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.905753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.906577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.907002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.002767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fc3b555f-4242-47fc-bf4b-ba88a3c81965 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110581 Jul 14 16:00:26.003477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 450/849] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:26.027943 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.029032 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.037514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.037999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.039023 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.039491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.451931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.452827 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.461249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.461699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.462813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.463249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.538514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.547290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.556207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.557798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-62c5e8d3-ad31-4b96-9e90-5ea47bb1b0af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1265 microversion: 2.1 time: 0.534997 Jul 14 16:00:26.558131 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:26.558411 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 400/850] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1265 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:26.559441 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-12a444a7-d2ab-49b4-b796-e9676d964772 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1332 microversion: 2.20 time: 0.111474 Jul 14 16:00:26.560176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 451/851] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:27.459347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-56e23a82-d80b-4820-b6c8-ecfda2dfb89b req-05b7d171-ef2d-48cb-a044-fb8764e450d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:27.469274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-56e23a82-d80b-4820-b6c8-ecfda2dfb89b req-05b7d171-ef2d-48cb-a044-fb8764e450d6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.469923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-56e23a82-d80b-4820-b6c8-ecfda2dfb89b req-05b7d171-ef2d-48cb-a044-fb8764e450d6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.482899 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-56e23a82-d80b-4820-b6c8-ecfda2dfb89b req-05b7d171-ef2d-48cb-a044-fb8764e450d6 service nova] Creating event network-changed:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 16:00:27.491232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-56e23a82-d80b-4820-b6c8-ecfda2dfb89b req-05b7d171-ef2d-48cb-a044-fb8764e450d6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033898 Jul 14 16:00:27.491232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 401/852] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:27.580728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.582712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.584099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.584921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.596232 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.597350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.598900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.599121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.599877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.600273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.601749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.602865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.805071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.814065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8adadc3b-37da-46b0-9159-e3ad1583a94a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1451 microversion: 2.1 time: 0.240493 Jul 14 16:00:27.815261 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 452/853] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1451 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:27.832149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.833587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.859330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.859330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.859330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.859330 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.914598 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.943432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.945313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.960222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b3ea8ef4-56dd-47fe-a4a9-6f91eab38bc7 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1332 microversion: 2.20 time: 0.384914 Jul 14 16:00:27.961367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 402/854] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:28.060098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:28.069955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d8d665a0-8a49-4ec5-a3d9-f09c527204e3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1451 microversion: 2.1 time: 0.242126 Jul 14 16:00:28.079869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 453/855] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:28.980213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.980213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.986959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.987745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.989322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.989769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.165704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:29.175084 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:29.177080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:29.178506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-92c5c26b-7c7a-448a-8b15-6f187c37423a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.203075 Jul 14 16:00:29.179514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 403/856] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:29.503901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-87c1efe5-d362-4a7d-a6f3-1369d7dcc369 req-9545fca3-d10f-4aa2-b679-8b656c45cfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:29.514298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-87c1efe5-d362-4a7d-a6f3-1369d7dcc369 req-9545fca3-d10f-4aa2-b679-8b656c45cfc7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.515543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-87c1efe5-d362-4a7d-a6f3-1369d7dcc369 req-9545fca3-d10f-4aa2-b679-8b656c45cfc7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.528749 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-87c1efe5-d362-4a7d-a6f3-1369d7dcc369 req-9545fca3-d10f-4aa2-b679-8b656c45cfc7 service nova] Creating event network-changed:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 16:00:29.534974 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-87c1efe5-d362-4a7d-a6f3-1369d7dcc369 req-9545fca3-d10f-4aa2-b679-8b656c45cfc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034520 Jul 14 16:00:29.540967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 454/857] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:30.205746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.208122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.235382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.235382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.235382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.235382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.485408 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.499244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.501488 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.503856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5db652d5-2103-4eb5-86ca-0e85111e0e27 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.309536 Jul 14 16:00:30.504508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 404/858] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:30.733648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-48d3e3c9-cf19-47b8-bc9c-e640b3e3d0c1 req-a02b20c4-da81-41f2-ba24-2636df497ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1d5480-e5d1-4ed5-ba9d-185d99c20286", "tag": "24623b5e-2168-4725-aa9a-7cf93495ac58"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:30.744257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-48d3e3c9-cf19-47b8-bc9c-e640b3e3d0c1 req-a02b20c4-da81-41f2-ba24-2636df497ea7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.744782 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-48d3e3c9-cf19-47b8-bc9c-e640b3e3d0c1 req-a02b20c4-da81-41f2-ba24-2636df497ea7 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.757336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-48d3e3c9-cf19-47b8-bc9c-e640b3e3d0c1 req-a02b20c4-da81-41f2-ba24-2636df497ea7 service nova] Creating event network-changed:24623b5e-2168-4725-aa9a-7cf93495ac58 for instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 on hv-cinder-83716 Jul 14 16:00:30.762964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-48d3e3c9-cf19-47b8-bc9c-e640b3e3d0c1 req-a02b20c4-da81-41f2-ba24-2636df497ea7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 Jul 14 16:00:30.763659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 455/859] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:31.524448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.525094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.531425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.531879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.532662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.533105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.554287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-8e680e61-94b5-4693-bce2-a3a60c4d0a4a req-56a94444-f9a4-4adf-b7d2-55eee796c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:31.565457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-8e680e61-94b5-4693-bce2-a3a60c4d0a4a req-56a94444-f9a4-4adf-b7d2-55eee796c3c2 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.566340 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-8e680e61-94b5-4693-bce2-a3a60c4d0a4a req-56a94444-f9a4-4adf-b7d2-55eee796c3c2 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.581429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-8e680e61-94b5-4693-bce2-a3a60c4d0a4a req-56a94444-f9a4-4adf-b7d2-55eee796c3c2 service nova] Creating event network-changed:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:00:31.592725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-8e680e61-94b5-4693-bce2-a3a60c4d0a4a req-56a94444-f9a4-4adf-b7d2-55eee796c3c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042622 Jul 14 16:00:31.594243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 456/860] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:31.681833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.690087 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.691633 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.692749 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bd43f0ef-71b8-493f-9469-055a8524252e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.173396 Jul 14 16:00:31.693306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 405/861] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:32.712806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.713514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.720762 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.721206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.722030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.722491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.854934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.863634 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.865171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.866318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6baf1622-76a6-483a-96a3-49efae377d06 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.157809 Jul 14 16:00:32.866912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 457/862] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:33.885516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.886103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.888188 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:33.888823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=12 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:33.894761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.895233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.896013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.896657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.448504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.461025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.463067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.464340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c62e0888-5aa1-4472-9cd3-a4c3a5556364 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.582872 Jul 14 16:00:34.464994 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 406/863] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:35.483073 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.483687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.491080 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.491531 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.492307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.492746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.629756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.638342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.639878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.640985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-72d657d6-9a49-4086-98d0-24ac766793c1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.161851 Jul 14 16:00:35.641552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 458/864] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:36.659335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.659953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.667482 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.667955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.668727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.669171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.816645 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.825446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.827012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.828135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-89022066-1bcc-4179-a4eb-800902cd64ac tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.172980 Jul 14 16:00:36.828692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 407/865] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:37.848090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.848616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.850942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:37.855682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.856138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.856958 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.857397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.989040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:37.997139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:37.998672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:37.999774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0a226372-d74a-4d9b-83d3-a37b6d0b1b3a tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.156792 Jul 14 16:00:38.000337 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 459/866] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:38.400949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-3635826f-f2d4-47e1-bc80-72e8f72ef9a6 req-1bf6ed62-5f9a-4794-abe3-ce0dbe424a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "name": "network-vif-plugged", "status": "completed", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:38.409528 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-3635826f-f2d4-47e1-bc80-72e8f72ef9a6 req-1bf6ed62-5f9a-4794-abe3-ce0dbe424a62 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.410075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-3635826f-f2d4-47e1-bc80-72e8f72ef9a6 req-1bf6ed62-5f9a-4794-abe3-ce0dbe424a62 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.420916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-3635826f-f2d4-47e1-bc80-72e8f72ef9a6 req-1bf6ed62-5f9a-4794-abe3-ce0dbe424a62 service nova] Creating event network-vif-plugged:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:00:38.426083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-3635826f-f2d4-47e1-bc80-72e8f72ef9a6 req-1bf6ed62-5f9a-4794-abe3-ce0dbe424a62 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028836 Jul 14 16:00:38.426678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 408/867] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:39.018055 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:39.018666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:39.025902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.026450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.027173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.027570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.172957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:39.182570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:39.184217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:39.185448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9506c634-7d76-4767-9172-3654230e3d63 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.171288 Jul 14 16:00:39.186084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 460/868] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:39 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:40.207415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.208162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.215485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.215964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.216814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.217254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.358780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.366796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.368301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.369404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6e2d53a8-db87-4f5c-96c4-d50f7f54371f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1405 microversion: 2.20 time: 0.167084 Jul 14 16:00:40.369986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 409/869] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:41.387324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.387928 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.394517 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.394964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.395720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.396148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.682521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.690511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.692019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.693159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-201ce03f-dbe9-4d11-a57a-2b1257966703 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1596 microversion: 2.20 time: 0.309785 Jul 14 16:00:41.693713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 461/870] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1596 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:00:41.710447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.710983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.717427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.717920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.718695 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.719136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.800676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-21aa5baf-341e-4bc6-bbdf-5b093996a335 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094055 Jul 14 16:00:41.801273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 410/871] 10.222.0.47 () {60 vars in 1315 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:00:42.895036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-360f29b2-48f7-468e-b28d-eb41f53064b8 req-a0432e81-0a83-42bf-91fe-616931167488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:42.903420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-360f29b2-48f7-468e-b28d-eb41f53064b8 req-a0432e81-0a83-42bf-91fe-616931167488 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.903859 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-360f29b2-48f7-468e-b28d-eb41f53064b8 req-a0432e81-0a83-42bf-91fe-616931167488 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.915861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-360f29b2-48f7-468e-b28d-eb41f53064b8 req-a0432e81-0a83-42bf-91fe-616931167488 service nova] Creating event network-changed:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:00:42.921216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-360f29b2-48f7-468e-b28d-eb41f53064b8 req-a0432e81-0a83-42bf-91fe-616931167488 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092979 Jul 14 16:00:42.921831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 462/872] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:54.224055 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:54.224840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=74 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:54.445662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.446198 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.452543 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.453000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.453785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.454504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.479308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a0158c2e-b7fb-4d74-9930-62f9d867cd72 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/ips" status: 200 len: 150 microversion: 2.1 time: 0.256617 Jul 14 16:00:54.479943 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 411/873] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/ips => generated 150 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:56.313385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=7 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:56.314382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=79 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:56.319058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60193b42-c58c-4593-a065-6464c8de8a38"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:56.323379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.326994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.327455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.328246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.328688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.276057 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d9c41e35-ecf4-46f8-ad46-e5ca85369d5b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964083 Jul 14 16:00:57.277152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 463/874] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:00:56 2022] POST /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 194 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:06.012743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60193b42-c58c-4593-a065-6464c8de8a38"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:06.014784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:06.022198 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:06.023308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:06.024948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.025478 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.026383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.027189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.136068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: POST /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments HTTP/1.1 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 74 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:01:06.140596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {"volumeAttachment": {"volumeId": "60193b42-c58c-4593-a065-6464c8de8a38"}} Jul 14 16:01:06.142078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'server_id': '33bd946f-13d5-4770-902b-142bc1dfb76a', 'body': {'volumeAttachment': {'volumeId': '60193b42-c58c-4593-a065-6464c8de8a38'}}} Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:06.142864 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:06.144101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 400 to user: Invalid volume: volume 60193b42-c58c-4593-a065-6464c8de8a38 is already attached to instances: 33bd946f-13d5-4770-902b-142bc1dfb76a {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:06.145354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c7d74d79-6487-4533-842a-17b5df4b73cd tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134589 Jul 14 16:01:06.156725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 412/875] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:01:06 2022] POST /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:01:06.220653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:06.221348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:06.229145 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.229844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.230838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.231444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.343302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'services' on Instance uuid 33bd946f-13d5-4770-902b-142bc1dfb76a {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:06.543010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e9446cca-e095-425d-8705-af7a93a63f61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments/60193b42-c58c-4593-a065-6464c8de8a38" status: 202 len: 0 microversion: 2.1 time: 0.326921 Jul 14 16:01:06.548760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 464/876] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:01:06 2022] DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments/60193b42-c58c-4593-a065-6464c8de8a38 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:06.565647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:06.567036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:06.584017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.584526 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.585451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.588300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.648692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-53f9ac44-8950-4354-b24a-809286401e3c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095649 Jul 14 16:01:06.649399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 413/877] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:06 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:07.657808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:07.659009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:07.666058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.666510 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.667333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.667766 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.699642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-af1344d6-4449-43bb-90ee-db9b753e2e45 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Jul 14 16:01:07.700271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 465/878] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:07 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:08.717466 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:08.720571 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:08.735844 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:08.736615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:08.738531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:08.739337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:08.797507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a3e3cd7b-a01c-4bb6-90b3-0aeb7ea88ca2 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087622 Jul 14 16:01:08.798683 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 414/879] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:08 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:09.264278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.265805 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.272787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.273490 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.274287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.274723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.310360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2be976ac-3961-4db6-b952-3edfdb2f9385 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049820 Jul 14 16:01:09.311644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 466/880] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:09 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:01:09.377694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.378714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.386340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.387029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.387901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.388363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.414649 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:09.750237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f4b2a2b4-fa06-4b5b-bb63-3b80a0bf209b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 204 len: 0 microversion: 2.1 time: 0.376257 Jul 14 16:01:09.752208 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 415/881] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:09 2022] DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:09.761046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.762044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.770212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.770762 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.771755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.772267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.811506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.812660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.827609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.828205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.829261 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.829980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.890250 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4369eee9-429a-45b8-a245-83fd54248e6d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083274 Jul 14 16:01:09.891457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 416/882] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:09 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:01:09.936528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:09.945265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a188d439-ae60-42ef-b91c-9ca576b6d0ed tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1674 microversion: 2.1 time: 0.188786 Jul 14 16:01:09.955978 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 467/883] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:09 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:09.973139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.974190 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.982070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.983314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.984424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.985035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.013445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:10.361711 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c4b85083-96a8-4ccb-8454-33fa35529c67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 204 len: 0 microversion: 2.1 time: 0.393280 Jul 14 16:01:10.363120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 417/884] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:09 2022] DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:10.376193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:10.377270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:10.388484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.389135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.390406 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.391121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.551945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:10.560318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f3e3b841-3309-4be8-8757-1a15280e8218 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1683 microversion: 2.1 time: 0.191373 Jul 14 16:01:10.561554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 468/885] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:10 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:10.963321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:10.964057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:10.970965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.971405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.972197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.972639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.193169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:11.200922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cf399542-9ab4-424c-8bcc-5e9f80dca4c6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1674 microversion: 2.1 time: 0.241822 Jul 14 16:01:11.201450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 418/886] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:10 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:11.582796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:11.584018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:11.593231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.594038 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.595144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.595748 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.750207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:11.759927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0ffe58ca-2747-49bc-b2e4-c0fefe93b045 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1683 microversion: 2.1 time: 0.185644 Jul 14 16:01:11.760627 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 469/887] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:11 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:12.084107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-63973661-1e74-4ed9-9d74-2718b39bac85 req-2b3e5b9c-8758-4c90-99f2-fda56a2bc115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14712f2-30e1-4219-a304-3769e1912a99", "name": "network-vif-deleted", "tag": "911c67db-7509-459b-89bb-c26fca3d2074"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:12.092887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-63973661-1e74-4ed9-9d74-2718b39bac85 req-2b3e5b9c-8758-4c90-99f2-fda56a2bc115 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.093327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-63973661-1e74-4ed9-9d74-2718b39bac85 req-2b3e5b9c-8758-4c90-99f2-fda56a2bc115 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.109842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-63973661-1e74-4ed9-9d74-2718b39bac85 req-2b3e5b9c-8758-4c90-99f2-fda56a2bc115 service nova] Creating event network-vif-deleted:911c67db-7509-459b-89bb-c26fca3d2074 for instance c14712f2-30e1-4219-a304-3769e1912a99 on hv-cinder-83716 Jul 14 16:01:12.115298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-63973661-1e74-4ed9-9d74-2718b39bac85 req-2b3e5b9c-8758-4c90-99f2-fda56a2bc115 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Jul 14 16:01:12.116473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 419/888] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:12.218533 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:12.219311 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:12.229933 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.230386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.231189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.233343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.327450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:12.335818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2ef20d19-0862-49bc-a96f-8c5262c0eba4 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1606 microversion: 2.1 time: 0.121036 Jul 14 16:01:12.336641 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 470/889] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:12 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:12.779162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:12.780273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:12.790794 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.791640 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.792493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.793183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.979773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:12.989011 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4b1105d4-3f47-4656-8f64-a2cf4389e5be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1683 microversion: 2.1 time: 0.214346 Jul 14 16:01:12.989694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 420/890] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:12 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:13.355797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:13.357065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:13.365542 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.366417 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.367487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.368148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.416267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.416831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.417290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lazy-loading 'fault' on Instance uuid c14712f2-30e1-4219-a304-3769e1912a99 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:13.459486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:13.469095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9ceeac75-954a-476a-b4e6-25ab05532b8f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 200 len: 1326 microversion: 2.1 time: 0.119815 Jul 14 16:01:13.470244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 471/891] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:13 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:14.007373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.007937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.014880 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.015603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.016552 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.017168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.109773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:14.133711 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-05b00602-8f54-4ca6-a527-03dd9510c580 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1615 microversion: 2.1 time: 0.131141 Jul 14 16:01:14.134718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 421/892] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:14 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1615 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:14.431382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-d9d7f6f9-bf03-4146-93d2-0acb48d4d72a req-0ee6d2cf-afa0-4cec-831f-1b212f9ed905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bd946f-13d5-4770-902b-142bc1dfb76a", "name": "network-vif-deleted", "tag": "571cdd06-9071-4e46-9c3b-2bddee54f4f9"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:14.445014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d9d7f6f9-bf03-4146-93d2-0acb48d4d72a req-0ee6d2cf-afa0-4cec-831f-1b212f9ed905 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.448010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d9d7f6f9-bf03-4146-93d2-0acb48d4d72a req-0ee6d2cf-afa0-4cec-831f-1b212f9ed905 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.458421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-d9d7f6f9-bf03-4146-93d2-0acb48d4d72a req-0ee6d2cf-afa0-4cec-831f-1b212f9ed905 service nova] Creating event network-vif-deleted:571cdd06-9071-4e46-9c3b-2bddee54f4f9 for instance 33bd946f-13d5-4770-902b-142bc1dfb76a on hv-cinder-83716 Jul 14 16:01:14.464598 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-d9d7f6f9-bf03-4146-93d2-0acb48d4d72a req-0ee6d2cf-afa0-4cec-831f-1b212f9ed905 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039023 Jul 14 16:01:14.465478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 472/893] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:14.486908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.488160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.498490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.498947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.499736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.500176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.545509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 HTTP/1.1 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:01:14.551741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:01:14.553399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'c14712f2-30e1-4219-a304-3769e1912a99'} Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:14.554700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:01:14.556678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:14.558373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:14.562167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-77e26296-ae70-4460-afa7-256256c177ca tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 404 len: 111 microversion: 2.1 time: 0.070871 Jul 14 16:01:14.565980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 422/894] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:14 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:14.574370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b13b9737-1dbf-491c-9c5e-6672568a3ade tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '.version_select at 0x7f33ffd9b820>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.986985 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.987551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.993612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.994097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.995566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.995566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.089125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'services' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:15.134739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b13b9737-1dbf-491c-9c5e-6672568a3ade tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446542729" status: 202 len: 0 microversion: 2.1 time: 0.566543 Jul 14 16:01:15.135989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 473/895] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 14 16:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446542729 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:15.178752 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:15.179609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:15.194573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.195415 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.197100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.198010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.285373 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:15.294027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1ccb31b3-d984-456d-8fc5-aa6ed03736d0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1327 microversion: 2.1 time: 0.145979 Jul 14 16:01:15.303583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 474/896] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:15 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:15.575765 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-676cb30a-07e2-4061-bd3d-353c486cac0f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments/0a15b5ba-fcdd-4b08-b2f7-f53fb703e019" status: 202 len: 0 microversion: 2.1 time: 0.590470 Jul 14 16:01:15.582273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 423/897] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:01:14 2022] DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments/0a15b5ba-fcdd-4b08-b2f7-f53fb703e019 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:01:15.590546 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:15.593371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:15.604818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.608324 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.611428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.613451 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.671217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5ce6afd3-191a-45a0-8b23-8c231e2b02c1 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084881 Jul 14 16:01:15.672630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 475/898] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:15 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:16.313213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:16.313918 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:16.325217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.329680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.329680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.329680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.330679 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-be41fb92-c36b-4b02-a50b-debed71ffb1e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: .version_select at 0x7f33ffe65ee0>, body: {"keypair": {"name": "tempest-keypair-2035652997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGIL8ZmMG0sPpg6Fxc9z9XYKHj1WFSEd950goaOxO9yevKQ632yKkvzgRBjeLCCmapCGpjzCyCU7qX/kIzGh/UzL2N10GbbQiAN6pbYIZwoEsJBV+vsY4iv+lZZodvizw=="}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:16.348800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-be41fb92-c36b-4b02-a50b-debed71ffb1e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:16.353198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-be41fb92-c36b-4b02-a50b-debed71ffb1e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for user dcdbbbf1b9944b09898fa8731184c845 and project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:16.374364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.375116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.375751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 33bd946f-13d5-4770-902b-142bc1dfb76a {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:16.425032 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:16.432834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ef9078a6-00e5-4f8c-9d60-df60f9274e13 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 200 len: 1332 microversion: 2.1 time: 0.124716 Jul 14 16:01:16.433451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 424/899] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:16 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:16.483126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-be41fb92-c36b-4b02-a50b-debed71ffb1e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157393 Jul 14 16:01:16.483738 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 476/900] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 16:01:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:16.584708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ea20e09c-5780-4849-ad6d-23118b41b915 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'create', calling method: .version_select at 0x7f33ff5c30d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-294235641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaSRTQni6Wa6LGCo6jxKcZw2s4AYVeLwplc8h5eGY/oAinnHSBtj4etyfxm46mvRV0tnKtWDJfERsmgo0U/oPdffU9WIsfIRz43tirxMTiFc+rewRLqFSzeuRBrjnNOpw=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:16.603826 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-ea20e09c-5780-4849-ad6d-23118b41b915 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Getting quotas for project 923fdefb5a7246038c012ee78bf00dc2. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:16.603935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-ea20e09c-5780-4849-ad6d-23118b41b915 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Getting quotas for user 2c1f1c69e35847b9a6323d8dd3863bf7 and project 923fdefb5a7246038c012ee78bf00dc2. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:16.685037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:16.686012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:16.693984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.694445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.695243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.695698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.728116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e28910fb-de6b-4359-841a-d3723f899a7c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Jul 14 16:01:16.728869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 477/901] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:16 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:16.776662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ea20e09c-5780-4849-ad6d-23118b41b915 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.196714 Jul 14 16:01:16.777414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 425/902] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 16:01:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:16.831703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2137782952", "imageRef": "779ae1a5-363f-48d5-94b2-49e7666ae546", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-294235641", "networks": [{"uuid": "280b43e4-2a25-48dc-a3c0-241a3356570c"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:16.890971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] validate_networks() for [('280b43e4-2a25-48dc-a3c0-241a3356570c', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:01:17.455432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.456083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:17.466115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.466586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.467430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.467888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.495462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a HTTP/1.1 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:01:17.497718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:01:17.504542 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '33bd946f-13d5-4770-902b-142bc1dfb76a'} Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:17.505564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:01:17.507081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:01:17.508366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:17.508366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-94dbafd6-a715-456a-9b43-f93895f2a88c tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 404 len: 111 microversion: 2.1 time: 0.050635 Jul 14 16:01:17.508366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 426/903] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:17 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:17.512700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9033a567-40cc-4f62-92e8-f1c2025f5fc3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '.version_select at 0x7f33ff67dd30>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.763338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:01:17.764257 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:01:17.764817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:01:17.765432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:01:17.766212 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:01:17.778577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.779038 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.779918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.780375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.802502 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Getting quotas for project 923fdefb5a7246038c012ee78bf00dc2. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:17.808959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Getting quotas for user 2c1f1c69e35847b9a6323d8dd3863bf7 and project 923fdefb5a7246038c012ee78bf00dc2. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:17.825419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:01:17.828278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='779ae1a5-363f-48d5-94b2-49e7666ae546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:01:17.832315 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9033a567-40cc-4f62-92e8-f1c2025f5fc3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881784164" status: 202 len: 0 microversion: 2.1 time: 0.324826 Jul 14 16:01:17.833161 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 427/904] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 14 16:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881784164 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:17.840069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.842678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:17.856661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.858607 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.863834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.863834 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.868919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:17.901056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8b17be67-eaa2-4563-9187-7782b6102148 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066427 Jul 14 16:01:17.902718 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 428/905] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:17 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:01:17.993297 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.994211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.001191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.002125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.003838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.004596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.038937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ae97dfed-d31a-400a-92a2-2ba7d6fdaf6f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210834 Jul 14 16:01:18.040506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 478/906] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:01:18.045640 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:18.057560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-93da24f0-9484-4527-b7ae-42df489a18a5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:18.058808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-93da24f0-9484-4527-b7ae-42df489a18a5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.152031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-93da24f0-9484-4527-b7ae-42df489a18a5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:18.160920 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-93da24f0-9484-4527-b7ae-42df489a18a5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1258 microversion: 2.1 time: 0.111994 Jul 14 16:01:18.161851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 479/907] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:18 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1258 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:18.561802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9c6aa42d-da88-461e-89fe-38ed0f0decce tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 204 len: 0 microversion: 2.1 time: 0.575489 Jul 14 16:01:18.562451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 429/908] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:17 2022] DELETE /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:01:18.573628 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:18.574799 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.587548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.594722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.594722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.594722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.773123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:18.783432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-aef2beec-67dc-4246-8d8e-397c625e352f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1690 microversion: 2.1 time: 0.216123 Jul 14 16:01:18.784015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 480/909] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:18 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:18.994652 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c99e00d6-ab91-464a-8a2e-fb959ffbb7de tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: .version_select at 0x7f33ff48caf0>, body: {"keypair": {"name": "tempest-keypair-103466588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkf+12efDPQH+XrQ0O9AH1OorWxT+gBU8mvRsSXWTTnyl3IszztccKWbYH2uvdTvf+n0AoMemmb8sbjHEX30NOLpmPRhnFBkwb6FW7gPqtyX4J77G21n315UIgHmy/DXQ=="}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:19.011229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-c99e00d6-ab91-464a-8a2e-fb959ffbb7de tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:19.019622 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-c99e00d6-ab91-464a-8a2e-fb959ffbb7de tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'key_pairs'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:19.179679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c99e00d6-ab91-464a-8a2e-fb959ffbb7de tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189678 Jul 14 16:01:19.181000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 430/910] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 16:01:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:19.185486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-74c4ddb9-63dd-49c0-9a94-316e7b797bbe tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:19.186643 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-74c4ddb9-63dd-49c0-9a94-316e7b797bbe tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:19.258694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-74c4ddb9-63dd-49c0-9a94-316e7b797bbe tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:19.267250 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-74c4ddb9-63dd-49c0-9a94-316e7b797bbe tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1258 microversion: 2.1 time: 0.087133 Jul 14 16:01:19.267837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 481/911] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:19 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:19.805684 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:19.806949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:19.819049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.819756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.820837 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.821492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.070699 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:20.078164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c60d3710-6d74-4fa4-a795-d95dc9369e54 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1690 microversion: 2.1 time: 0.278861 Jul 14 16:01:20.079066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 431/912] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:19 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1690 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:20.285687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ebcf2b7c-3376-48a2-9fa5-6627a51a7dc9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:20.286277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ebcf2b7c-3376-48a2-9fa5-6627a51a7dc9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:20.364333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ebcf2b7c-3376-48a2-9fa5-6627a51a7dc9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:20.371818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ebcf2b7c-3376-48a2-9fa5-6627a51a7dc9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1258 microversion: 2.1 time: 0.090926 Jul 14 16:01:20.381687 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 482/913] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:20 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:20.438105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2146347289", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "497f31f1-708e-4d4b-b1f8-f98fa9d7e1e1"}], "security_groups": [{"name": "tempest-securitygroup--1767506142"}], "key_name": "tempest-keypair-2035652997", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:20.558516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] validate_networks() for [('497f31f1-708e-4d4b-b1f8-f98fa9d7e1e1', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:01:20.986176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:01:20.986722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:01:20.987112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:01:20.988066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:01:20.988475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:01:20.998820 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.999340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.000063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.000513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.021237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:21.023947 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Getting quotas for user dcdbbbf1b9944b09898fa8731184c845 and project 64a86c4d5f1043ca93987ed2c77a3629. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:21.036076 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:01:21.038500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:01:21.068086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:21.096911 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.097613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.105780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.112994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.112994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.112994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.130456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:21.250603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0ea4f07f-3b7a-4f49-830e-f16f079905fb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.816846 Jul 14 16:01:21.259219 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 432/914] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:01:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:01:21.264740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-83c4e74e-d3b0-4b9c-beee-f09e090f73fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.265370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-83c4e74e-d3b0-4b9c-beee-f09e090f73fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.350727 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:21.369543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2787e1fe-95d0-4b7e-982d-531de249c79a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1690 microversion: 2.1 time: 0.276166 Jul 14 16:01:21.372270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 483/915] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1690 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:21.402918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.404955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.417084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.417998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.419064 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.419767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.559459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:21.570634 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2813fe71-37b3-4883-b13e-206ffd64c099 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1262 microversion: 2.1 time: 0.177145 Jul 14 16:01:21.583499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 484/916] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1262 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:21.647377 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-83c4e74e-d3b0-4b9c-beee-f09e090f73fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:21.654841 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-83c4e74e-d3b0-4b9c-beee-f09e090f73fa tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1238 microversion: 2.1 time: 0.394063 Jul 14 16:01:21.655430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 433/917] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1238 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:22.391482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.393099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.406983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.418345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.418345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.418345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.558609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:22.567113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-97c67f04-fc3b-4d6d-a84b-b96f1c812c07 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1690 microversion: 2.1 time: 0.179977 Jul 14 16:01:22.568142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 485/918] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:22.588790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1280748848", "imageRef": "c9acf5e7-89ea-4a78-a06e-9080b8910c70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761c7f07-2b9f-4965-8183-b20363082c34"}], "security_groups": [{"name": "tempest-securitygroup--2818721"}], "key_name": "tempest-keypair-103466588", "user_data": "}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:22.596722 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.602265 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.609360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.611986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.611986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.611986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.702207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:22.712065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-61748709-1050-48b2-b541-d865de846d45 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1254 microversion: 2.1 time: 0.119359 Jul 14 16:01:22.715787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 486/919] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1254 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:22.717348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.717983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.725434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.725915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.726692 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.727126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.795469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] validate_networks() for [('761c7f07-2b9f-4965-8183-b20363082c34', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:01:22.805419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:22.814685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1acced3e-979a-40a8-973e-2f2ffdd2ddc8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1242 microversion: 2.1 time: 0.100935 Jul 14 16:01:22.824823 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 487/920] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:23.585254 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.587062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.595147 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.595884 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.596937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.597619 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.598736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:01:23.599244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:01:23.599737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:01:23.600151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:01:23.600572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:01:23.614335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.615616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.616275 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.616726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.637257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:23.641778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Getting quotas for user c4fd1155ff11417db8c647f0aadf74a1 and project 975f7cf0a1f5445cb45ea441b3c056d5. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:23.657270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:01:23.659541 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acf5e7-89ea-4a78-a06e-9080b8910c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:01:23.773017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:23.781465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6a78b57e-d7d8-4257-9bab-48ff02ecd462 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1690 microversion: 2.1 time: 0.200976 Jul 14 16:01:23.782221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 488/921] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:23.787130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.787822 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.795505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.795956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.796751 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.797193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.891553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:23.899520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d7272582-d99a-4339-8952-c725006782b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1318 microversion: 2.1 time: 0.116161 Jul 14 16:01:23.900302 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 489/922] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:23.904642 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.905280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.919017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.919503 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.920300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.920762 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.922924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-dc2ac46a-5b9e-4de4-8255-bad27aa4d880 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.339065 Jul 14 16:01:23.924448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 434/923] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:01:22 2022] POST /compute/v2.1/servers => generated 399 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:01:23.937397 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a18d496c-cfd0-4e63-9e65-ee8c63ee2fab tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.938602 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a18d496c-cfd0-4e63-9e65-ee8c63ee2fab tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.020395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:24.032229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a3070e79-9730-4765-8d12-6e0b3c5e02ea tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1290 microversion: 2.1 time: 0.130961 Jul 14 16:01:24.032765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 490/924] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:24.070155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a18d496c-cfd0-4e63-9e65-ee8c63ee2fab tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:24.078425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a18d496c-cfd0-4e63-9e65-ee8c63ee2fab tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1241 microversion: 2.1 time: 0.145618 Jul 14 16:01:24.081930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 435/925] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:24.465509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-c680d433-e1b6-4a68-9a50-de5cf302f449 req-5322f0a8-5c34-4afe-89dd-e17b48354ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55564827-8025-4413-832b-e84ef63d1b01", "name": "network-vif-deleted", "tag": "a13d5307-6bb7-483c-9318-06594f3ffb0c"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:24.479196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c680d433-e1b6-4a68-9a50-de5cf302f449 req-5322f0a8-5c34-4afe-89dd-e17b48354ca3 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.479659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c680d433-e1b6-4a68-9a50-de5cf302f449 req-5322f0a8-5c34-4afe-89dd-e17b48354ca3 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.502333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-c680d433-e1b6-4a68-9a50-de5cf302f449 req-5322f0a8-5c34-4afe-89dd-e17b48354ca3 service nova] Creating event network-vif-deleted:a13d5307-6bb7-483c-9318-06594f3ffb0c for instance 55564827-8025-4413-832b-e84ef63d1b01 on hv-cinder-83716 Jul 14 16:01:24.509536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-c680d433-e1b6-4a68-9a50-de5cf302f449 req-5322f0a8-5c34-4afe-89dd-e17b48354ca3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047923 Jul 14 16:01:24.510501 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 491/926] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:24.802042 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:24.810479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.823699 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.824364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.825362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.826079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.925668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:24.931768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.953418 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.955752 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.959112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.962463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.981937 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:24.997651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f1361e8c-6035-4efe-b70d-25d88c1d318d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1330 microversion: 2.1 time: 0.200669 Jul 14 16:01:25.005360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 436/927] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:24 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:25.062302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:25.062976 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:25.086243 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.086807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.087889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.090532 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.188069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:25.228951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-93a48399-7698-4ecc-a267-24e7d4be726f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1316 microversion: 2.1 time: 0.312496 Jul 14 16:01:25.231433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 492/928] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:24 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:25.255944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:25.256894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:25.272461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.273607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.276341 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.277760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.344642 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:25.358421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4feeba00-64bd-426f-939f-ad4f38a1fb22 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1296 microversion: 2.1 time: 0.310773 Jul 14 16:01:25.363331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 437/929] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:25 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1296 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:25.461897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:25.470656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8d3373e9-2e21-4e51-9150-ca5d7bbc8e48 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1245 microversion: 2.1 time: 0.220302 Jul 14 16:01:25.473954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 493/930] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:25 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1245 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:26.016606 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.017221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.027963 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.028425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.029238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.031867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.103128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.103583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.104287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:26.200823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:26.212784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aa1a71ee-8273-4157-acf6-0436d452efc3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.200809 Jul 14 16:01:26.213398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 438/931] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:26.256532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.257241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.267784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:26.276104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.277135 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.288512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.288512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.390969 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.392128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.406229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.407071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.412239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.413321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.664395 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:26.672903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e105e87b-9c4d-4a34-87e3-64c37893d2e1 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.420880 Jul 14 16:01:26.686914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 494/932] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:26.693617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.694368 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.716520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.719798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.720912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.723533 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.764686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:26.778329 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fbff47bc-e470-4edb-a80e-0206b0af46a1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.401019 Jul 14 16:01:26.784036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 439/933] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:26.887009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:26.900753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-691c771b-83bb-4be3-b95d-af0e0e585e74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1245 microversion: 2.1 time: 0.224460 Jul 14 16:01:26.903755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 495/934] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1245 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:27.233077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.234610 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.248771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.249464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.251486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.252215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.304127 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.305072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.306210 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:27.418948 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:27.438814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0feb475c-143f-46d5-8190-696172793b6c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.209541 Jul 14 16:01:27.441875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 440/935] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:27.695273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.696662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.704563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.705728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.706927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.708312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.789130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:27.804174 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.805477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.813763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.814533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.816716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.817869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.988540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:27.992315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-52010046-57b1-4f76-9ed9-0d3efa2e22d5 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.301464 Jul 14 16:01:27.994132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 496/936] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:28.004597 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:28.006392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:28.025338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.031065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.033008 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.033361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.223814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:28.240344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8c1e43c0-cef3-4b77-b857-2b19439133c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.242370 Jul 14 16:01:28.248686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 497/937] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:28.464033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:28.465173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:28.487796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.488654 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.499949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.500902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.518241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:28.546032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.546600 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.547128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:28.559064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9b6e4024-dace-414e-a4c6-d2b58e0a263f tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.760755 Jul 14 16:01:28.565898 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 441/938] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:28.616076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:28.630046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0469e13e-74b6-4e08-b4c4-304c2bf466fa tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.175327 Jul 14 16:01:28.631448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 498/939] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:28 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:28.963285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-b87e7a47-9d98-49fa-b4c4-fbeeac255935 req-2eebea91-c3d0-435e-9c2a-ad89e7674b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8e9830-a6c1-4ad9-ae37-be5e7da42a26", "tag": "9c8671a6-14fb-4aad-8815-94096e9a058a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:29.009137 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-b87e7a47-9d98-49fa-b4c4-fbeeac255935 req-2eebea91-c3d0-435e-9c2a-ad89e7674b06 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.009839 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-b87e7a47-9d98-49fa-b4c4-fbeeac255935 req-2eebea91-c3d0-435e-9c2a-ad89e7674b06 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.011544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.012289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.027685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.031031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.032059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.033067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.041651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-b87e7a47-9d98-49fa-b4c4-fbeeac255935 req-2eebea91-c3d0-435e-9c2a-ad89e7674b06 service nova] Creating event network-changed:9c8671a6-14fb-4aad-8815-94096e9a058a for instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 on hv-cinder-83716 Jul 14 16:01:29.054327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-b87e7a47-9d98-49fa-b4c4-fbeeac255935 req-2eebea91-c3d0-435e-9c2a-ad89e7674b06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095460 Jul 14 16:01:29.055218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 442/940] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:29.260566 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.263721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.281030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.281770 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.284447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.284966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.294973 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:29.305036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-81292a0c-0909-4a05-b2b5-872d803e73dd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.298179 Jul 14 16:01:29.306290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 499/941] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:29.420869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:29.429938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-94d997f9-733b-4caf-8063-43952b460536 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.175462 Jul 14 16:01:29.436901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 443/942] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:29.576905 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.577525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.584393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.584850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.585635 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.586113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.606845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:29.650066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.650708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.657314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.657779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.658604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.659592 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.692533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.692990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.693444 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:29.732840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:29.744915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-25260c45-0736-4b3b-87a6-052e2220f115 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.171570 Jul 14 16:01:29.746062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 500/943] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:29.751217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.751710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.759849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.760456 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.761552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.762000 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.770231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:29.779482 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a0c5057d-04ab-4e16-972e-a2cf20b47300 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.134359 Jul 14 16:01:29.790092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 444/944] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:29.795845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bc7371aa-e80f-4ecd-b776-eaf358096bd8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/ips" status: 200 len: 151 microversion: 2.20 time: 0.048626 Jul 14 16:01:29.796611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 501/945] 10.222.0.47 () {60 vars in 1288 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:01:30.324933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.325514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.333703 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.334205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.335064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.335565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.448878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.449705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.452703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=16 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:30.459740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.460380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.461321 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.461849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.538379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:30.546806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0e834a64-c876-423e-906d-5f68318da6b5 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.102359 Jul 14 16:01:30.547389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 502/946] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:30.763669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.764289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.766267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:30.770735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.771095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.771880 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.772327 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.776068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-70d11cd1-c180-479b-a855-25853697c1c3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.456870 Jul 14 16:01:30.776925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 445/947] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:30.797029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.798278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.805710 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.806491 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.807273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.807883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.856126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.856869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.857504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:30.910204 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:30.914427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:30.921169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1fd184a0-ba17-4408-8111-205a1efb6eb8 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.128010 Jul 14 16:01:30.922358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 446/948] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:30.953836 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:30.963562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3149f728-e72b-4af6-8f9f-02048260a179 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.203626 Jul 14 16:01:30.965870 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 503/949] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:31.073070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-c91ae286-c9c1-4f53-a389-4aec47f83919 req-21277f34-81e2-4a34-b96a-af6b93f7f736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:31.085124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-c91ae286-c9c1-4f53-a389-4aec47f83919 req-21277f34-81e2-4a34-b96a-af6b93f7f736 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.085906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-c91ae286-c9c1-4f53-a389-4aec47f83919 req-21277f34-81e2-4a34-b96a-af6b93f7f736 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.099840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-c91ae286-c9c1-4f53-a389-4aec47f83919 req-21277f34-81e2-4a34-b96a-af6b93f7f736 service nova] Creating event network-changed:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:01:31.105328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-c91ae286-c9c1-4f53-a389-4aec47f83919 req-21277f34-81e2-4a34-b96a-af6b93f7f736 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035967 Jul 14 16:01:31.106158 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 447/950] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:31.567569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.568543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.575316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.575846 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.576826 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.577251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.665811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:31.674770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f2df2be1-fb39-4b48-8b21-d383127bc41f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.112377 Jul 14 16:01:31.675938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 504/951] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:31.795583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.796300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.810688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.810688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.810688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.810688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.939559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.940366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.968602 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.978040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.978040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.978040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.978741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:31.988629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0957a627-4c61-4ea3-bbae-50698a446cb8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.196918 Jul 14 16:01:31.989777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 448/952] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:31.996130 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.997197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:32.006024 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.010921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.010921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.010921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.011224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.011224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.011224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:32.083971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:32.102607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d2abee32-eadf-4b9e-a5c6-d4ad32dfc65f tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.162529 Jul 14 16:01:32.105121 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 505/953] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:32.198576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:32.208273 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a5a0788f-c91b-4c34-9925-35e057951770 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.216821 Jul 14 16:01:32.209431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 449/954] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:32.694910 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:32.696184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:32.703488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.704204 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.705308 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.706768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.780699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:32.789346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ba047c56-3008-410c-823d-7d7dd546862d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.098787 Jul 14 16:01:32.790306 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 506/955] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:32 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:33.015832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.017260 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.024756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.025560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.026908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.027589 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.120938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.122405 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.132214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.132988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.134193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.134814 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.169425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.170039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.170590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:33.202233 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:33.211862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b44588cf-86fc-45fb-86a1-1fd3d4698fe0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.200558 Jul 14 16:01:33.220815 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 450/956] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:33.221049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:33.225867 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-68b8796c-cec8-46a7-a15b-cc75f5cd6d61 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.108790 Jul 14 16:01:33.226459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 507/957] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:33.254073 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.258901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:33.259276 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.259698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.267425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.267897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.268818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.269254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.269380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.269865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.270826 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.271488 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.296240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lazy-loading 'flavor' on Instance uuid bd039734-918c-4c52-875a-ba68f8ef112d {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:33.437619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:33.450100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aba8d69b-067e-42d7-b265-3f5fa0167fc0 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.225230 Jul 14 16:01:33.457873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 451/958] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:33.810519 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.811164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.813240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:33.818518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.818977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.819758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.820202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.887431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:33.895634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6103bff1-1e6e-4936-b113-337514168d05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1237 microversion: 2.1 time: 0.091037 Jul 14 16:01:33.896540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 452/959] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:34.172515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3955ac5a-ba94-4346-a7e2-a985bc48b6a8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/action" status: 202 len: 0 microversion: 2.20 time: 0.918347 Jul 14 16:01:34.177629 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 508/960] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 14 16:01:33 2022] POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/action => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:01:34.182010 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.182615 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.185242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=24 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:34.190846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.191398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.192166 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.192714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.234157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.235019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.243796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.244439 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.245362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.245690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.411270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.414972 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.420647 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a2c30b1e-5bd5-424c-9b72-7eb6ca427c39 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.191556 Jul 14 16:01:34.420647 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 509/961] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:34.425347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.426125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.432291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.432795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.433624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.433809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.434159 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.435367 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.437107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cfb6ab57-d6a3-4d00-bdad-fd1dbdf89434 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.259198 Jul 14 16:01:34.450537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 453/962] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:01:34.472933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.473316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.473791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.474291 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 55564827-8025-4413-832b-e84ef63d1b01 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:34.474873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.487404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.494899 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.497550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.497550 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.538231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.546593 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-37ea7486-3cb0-4b33-bb01-506bf69fe425 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 200 len: 1335 microversion: 2.1 time: 0.125098 Jul 14 16:01:34.549263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 510/963] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 1335 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:34.809479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.818881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ee5e167c-3603-44a1-a92e-2cfc1dd04c33 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.351371 Jul 14 16:01:34.819479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 454/964] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:34.913613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.914269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.920908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.921431 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.922172 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.922635 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.004588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.020943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c0109f35-257b-479a-a02b-1261e4ffd897 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1293 microversion: 2.1 time: 0.111392 Jul 14 16:01:35.021984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 511/965] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:35.441034 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.442064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.450334 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.451077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.452068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.452513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.457793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.458736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.472125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.474822 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.480440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.481122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.650184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.658540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.660097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.661280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5375f6fc-8bd7-4404-bb81-0d0855ae0b86 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.208477 Jul 14 16:01:35.665954 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 512/966] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:35.667030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.667174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 55564827-8025-4413-832b-e84ef63d1b01] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.682918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.683380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.684160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.684599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.699680 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] HTTP exception thrown: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Request method failure captured: Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 HTTP/1.1 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxhUXoajOhh3ceVHksOZo9mrBJutckJmhJIeA0AAOAqzhvwYY2Oa7aqCfQvOPi1CHYnXizlJsZjgFaYJ72iXNuHRDRUdJA1kkOeNxnEy1tBVSXiCs4AqVdH1hg9qJlEgV5sF3QgMH7PhkOWWJ-QiJoqNH4nUPM3oQ20nXWLayZ5EEg Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:01:35.701361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_508fd5c51f544a3db6d0b87e37750e01", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/508fd5c51f544a3db6d0b87e37750e01"}]}] Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 81ca45714ee44a549fd002b4aa13973b Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. Jul 14 16:01:35.703117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '55564827-8025-4413-832b-e84ef63d1b01'} Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:35.703965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. Jul 14 16:01:35.705506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:35.708130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Returning 404 to user: Instance 55564827-8025-4413-832b-e84ef63d1b01 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:35.708130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5a865276-f651-4f3b-a792-7c5077ea3317 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01" status: 404 len: 111 microversion: 2.1 time: 0.040016 Jul 14 16:01:35.708130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 513/967] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/55564827-8025-4413-832b-e84ef63d1b01 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:35.712704 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-60c43c8a-59de-4e72-b618-0f3e453048d6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '.version_select at 0x7f33ff4cd550>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.806979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-60c43c8a-59de-4e72-b618-0f3e453048d6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145716787" status: 202 len: 0 microversion: 2.1 time: 0.098335 Jul 14 16:01:35.807568 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 514/968] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 14 16:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145716787 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:01:35.836973 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.837683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.846107 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.849934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.849934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.849934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.935728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.948396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f3cca1ca-bfcb-48e5-97b4-74545c2430aa tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.511995 Jul 14 16:01:35.956356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 455/969] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:36.042786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.044170 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.050907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.051369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.052310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.052957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.086016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.094646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4e3a0691-c757-452c-9a5a-8a3537b85524 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.261728 Jul 14 16:01:36.095503 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 515/970] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:36.175989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.184006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aad397c6-2ab4-4cb5-a525-19c670296593 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1299 microversion: 2.1 time: 0.146961 Jul 14 16:01:36.184634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 456/971] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:36.684965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.685590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.692510 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.693577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.693837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.694789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.699195 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:36.843498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.854054 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.855669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.857891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2827a11e-89d1-4fe3-8c89-07613865c2ff tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.176267 Jul 14 16:01:36.857891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 516/972] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:36.967630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.968409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.976650 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.977178 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.978043 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.978485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.114278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.114902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.122196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.126317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.126317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.126317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.282418 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:37.293682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-045ce514-d61c-4b80-813b-6073a1c85665 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.184843 Jul 14 16:01:37.304497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 517/973] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:37.304497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.304497 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.306672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.307206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.307892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.308323 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.467447 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:37.477658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2e7ae8d9-bbf7-4171-907b-cd5807457624 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.181836 Jul 14 16:01:37.487939 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 518/974] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:37.558682 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:37.565779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1f4958fb-8b87-4db7-8c24-db8e544c73c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.601941 Jul 14 16:01:37.566786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 457/975] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:37.876213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.876838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.887422 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.887845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.888645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.889086 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.030976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.040871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.042425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.043701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f53830ae-ae90-4d00-b2c1-27bec7a37ea1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.171535 Jul 14 16:01:38.044530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 519/976] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:38.312048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.312675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.320149 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.320536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.321333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.321850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.497454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.498445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.505071 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.505690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.506561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.507180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.551791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.561585 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4f4d7cd0-4cd7-4f4d-9bc0-5020c5c37c9e tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.253288 Jul 14 16:01:38.563363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 458/977] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:38.583036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.584027 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.591268 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.592309 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.593440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.594240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.692934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.702003 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-633a31b6-9f02-4bc3-bbb1-9b8e0508b2a6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.210636 Jul 14 16:01:38.702549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 520/978] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:38.808058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.816155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ed14253f-76fd-4068-9cee-605b0059d598 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.237145 Jul 14 16:01:38.816766 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 459/979] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:38.960918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-2c58cac4-af21-4ff3-95a1-89f0468cf5b6 req-3474492f-6447-4ab8-a212-8d2ba2aac0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695d9591-7c7f-45a3-8a37-9a4185a535bd", "tag": "5d409ea6-43c0-4937-b929-d8042170cd63"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:38.973250 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-2c58cac4-af21-4ff3-95a1-89f0468cf5b6 req-3474492f-6447-4ab8-a212-8d2ba2aac0d9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.974002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-2c58cac4-af21-4ff3-95a1-89f0468cf5b6 req-3474492f-6447-4ab8-a212-8d2ba2aac0d9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.987515 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-2c58cac4-af21-4ff3-95a1-89f0468cf5b6 req-3474492f-6447-4ab8-a212-8d2ba2aac0d9 service nova] Creating event network-changed:5d409ea6-43c0-4937-b929-d8042170cd63 for instance 695d9591-7c7f-45a3-8a37-9a4185a535bd on hv-cinder-83716 Jul 14 16:01:38.993798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-2c58cac4-af21-4ff3-95a1-89f0468cf5b6 req-3474492f-6447-4ab8-a212-8d2ba2aac0d9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038141 Jul 14 16:01:38.994449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 521/980] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:39.063308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.067414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.071840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.072291 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.073067 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.073501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.312826 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.322176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.323713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.324970 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-623b81ff-a09d-45e6-b266-dca519027892 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.265845 Jul 14 16:01:39.325563 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 460/981] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:39.582382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.584487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.589536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.590070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.590857 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.591513 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.720508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.721170 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.728842 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.729560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.731236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.731964 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.739917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.751078 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4102bfa8-1290-4307-a7ae-29db13709f54 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.172717 Jul 14 16:01:39.763094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 522/982] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:39.833226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.833519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.842102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.842272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.842952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.843390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.955754 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.964117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d8024390-c735-4547-b808-068c29d73a2f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.248592 Jul 14 16:01:39.964709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 461/983] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:39.996317 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.004052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-216353e3-43ef-475a-b85d-e2e37c280d37 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.175452 Jul 14 16:01:40.004620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 523/984] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:40.276716 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.277244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.283746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.284843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.285637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.286091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.312348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:40.344527 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.345137 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.352194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.352678 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.354579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.354579 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.475823 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:40.499364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.509325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.510783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.511982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-34855872-b3eb-46d1-bfcc-2a4af84934eb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.171627 Jul 14 16:01:40.512809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 524/985] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:01:40.737202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cfe5c434-3813-4c03-9290-2a2314cf6112 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 204 len: 0 microversion: 2.1 time: 0.463640 Jul 14 16:01:40.737921 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 462/986] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:40 2022] DELETE /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:40.747759 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.748382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.755435 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.755888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.756678 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.757113 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.772108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.772768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.779601 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.780057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.781231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.781696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.937993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.947345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-eacf1ccb-df34-44d6-8e79-f6091cca7715 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1508 microversion: 2.1 time: 0.203779 Jul 14 16:01:40.948062 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 525/987] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:40.951351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:40.963048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2f2ec52a-5e1b-4839-a3b7-a56b1cc87008 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.196748 Jul 14 16:01:40.963507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 463/988] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:40.985659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.986336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.993916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.994385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.995176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.995628 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.022577 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.023160 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.030818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.031206 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.032214 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.032727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.190390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.200069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.202532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-61227cd6-f6e9-4905-954f-c3b219d3ca55 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.224829 Jul 14 16:01:41.205626 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 526/989] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:41.211755 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ff6fdce8-e8ba-4a45-a5af-4577aa60b6b3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.194021 Jul 14 16:01:41.212596 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 464/990] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:41.531659 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.532464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.539959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.540468 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.541334 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.541848 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.688523 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.697518 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.699193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.700385 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-370d69dd-9b15-47b4-8c1d-2f370965c442 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.172796 Jul 14 16:01:41.700952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 527/991] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:41.965511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.966147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.969895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:41.974895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.975631 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.976621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.977064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.981669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.986945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.000009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.000499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.001334 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.001849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.161179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.161398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.169670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7e987bbd-6e3f-4b90-a982-bb4ca0e082d3 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1508 microversion: 2.1 time: 0.208135 Jul 14 16:01:42.170327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 465/992] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:42.171053 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c46bf956-633f-4957-bec1-5fcf346bb953 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.194225 Jul 14 16:01:42.171664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 528/993] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:42.231425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.232417 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.233559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.234588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.243148 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.243911 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.245356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.246193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.246743 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.247640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.248516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.249220 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.419379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.433592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-824af2cb-67f9-4653-a6cd-f194f542f33b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.206256 Jul 14 16:01:42.434607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 529/994] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:42.518499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.532183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-91732843-9cff-48bc-aa7b-e58026b8e570 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.307201 Jul 14 16:01:42.533709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 466/995] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:42.723462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.724420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.733272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.736492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.736492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.736492 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.910979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.922072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.932181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.932181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-66703226-77c0-4639-b820-594016ad68b1 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.215826 Jul 14 16:01:42.934012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 530/996] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:43.009460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-4a9ba6f9-c148-4a1e-bc5a-2c39da7f372d req-eba862ff-2863-4fbc-92d2-8a9fb44977a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537ae16a-face-46a6-9841-8bde80b7a056", "name": "network-vif-deleted", "tag": "362b8892-2aa5-426d-92be-a5ab32fd8d51"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:43.018321 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-4a9ba6f9-c148-4a1e-bc5a-2c39da7f372d req-eba862ff-2863-4fbc-92d2-8a9fb44977a0 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.019284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-4a9ba6f9-c148-4a1e-bc5a-2c39da7f372d req-eba862ff-2863-4fbc-92d2-8a9fb44977a0 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.032730 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-4a9ba6f9-c148-4a1e-bc5a-2c39da7f372d req-eba862ff-2863-4fbc-92d2-8a9fb44977a0 service nova] Creating event network-vif-deleted:362b8892-2aa5-426d-92be-a5ab32fd8d51 for instance 537ae16a-face-46a6-9841-8bde80b7a056 on hv-cinder-83716 Jul 14 16:01:43.045005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-4a9ba6f9-c148-4a1e-bc5a-2c39da7f372d req-eba862ff-2863-4fbc-92d2-8a9fb44977a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039128 Jul 14 16:01:43.048221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 467/997] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:43.188824 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.189661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.189874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.192369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.197949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.198693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.199844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.200436 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.202534 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.203179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.204586 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.205198 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.309633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:43.325433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f2db2164-91db-4ee8-aa23-56b6fdc8ec11 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 200 len: 1293 microversion: 2.1 time: 0.142432 Jul 14 16:01:43.338116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 531/998] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:43.479857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:43.489521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1d6563d4-954e-4a07-a79d-5777009d6fa9 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.304911 Jul 14 16:01:43.505904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 468/999] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:43.506758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.507549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.514934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.515693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.516662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.517325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.573532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-d59ad17b-136d-41b1-8ac9-e89551934cd8 req-a233313c-2361-43e9-9c01-6209c1a90960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "name": "network-vif-plugged", "status": "completed", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:43.586940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d59ad17b-136d-41b1-8ac9-e89551934cd8 req-a233313c-2361-43e9-9c01-6209c1a90960 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.587750 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d59ad17b-136d-41b1-8ac9-e89551934cd8 req-a233313c-2361-43e9-9c01-6209c1a90960 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.602464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-d59ad17b-136d-41b1-8ac9-e89551934cd8 req-a233313c-2361-43e9-9c01-6209c1a90960 service nova] Creating event network-vif-plugged:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:01:43.608022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-d59ad17b-136d-41b1-8ac9-e89551934cd8 req-a233313c-2361-43e9-9c01-6209c1a90960 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232110 Jul 14 16:01:43.608865 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 532/1000] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:43.615573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.616357 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.623421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.623957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.624801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.625301 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.697182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:43.708211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-41274f68-c22e-471a-9a1b-396311422f32 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.205941 Jul 14 16:01:43.709099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 469/1001] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:43.776347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:43.781297 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0a8c1f7a-76bf-4f72-abb6-7f1092fec439 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.170970 Jul 14 16:01:43.781898 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 533/1002] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:43.955301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.956903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.964587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.964977 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.965763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.966221 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.153627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.164435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.166200 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.167675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-19d83887-951b-4f06-8188-d3fb390a2bcb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.219570 Jul 14 16:01:44.168758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 470/1003] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:44.346231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.347388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 537ae16a-face-46a6-9841-8bde80b7a056] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.354280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.354737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.355520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.355952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.360290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:44.370938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] HTTP exception thrown: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Request method failure captured: Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 HTTP/1.1 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxhUXoajOhh3ceVHksOZo9mrBJutckJmhJIeA0AAOAqzhvwYY2Oa7aqCfQvOPi1CHYnXizlJsZjgFaYJ72iXNuHRDRUdJA1kkOeNxnEy1tBVSXiCs4AqVdH1hg9qJlEgV5sF3QgMH7PhkOWWJ-QiJoqNH4nUPM3oQ20nXWLayZ5EEg Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:01:44.372615 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_508fd5c51f544a3db6d0b87e37750e01", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/508fd5c51f544a3db6d0b87e37750e01"}]}] Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 81ca45714ee44a549fd002b4aa13973b Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. Jul 14 16:01:44.374244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '537ae16a-face-46a6-9841-8bde80b7a056'} Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:44.375322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. Jul 14 16:01:44.376791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:44.378174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Returning 404 to user: Instance 537ae16a-face-46a6-9841-8bde80b7a056 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:44.378174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3aaf89cb-8168-4822-aa17-0fff8ff1001e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056" status: 404 len: 111 microversion: 2.1 time: 0.032657 Jul 14 16:01:44.378174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 534/1004] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/537ae16a-face-46a6-9841-8bde80b7a056 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:44.383078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.383573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.389879 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.390331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.391124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.391557 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.417551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:44.506962 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.507505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.514249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.514712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.515491 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.515935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.661853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.670207 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f7c3f07d-a8e5-4a5f-a221-1d25e2de1611 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.167223 Jul 14 16:01:44.670793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 535/1005] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:44.726108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.726755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.732964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.733415 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.734249 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.734688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.750354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2aea5e1b-9477-4efa-85b4-32579fa59c1a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 204 len: 0 microversion: 2.1 time: 0.370689 Jul 14 16:01:44.751597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 471/1006] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:44 2022] DELETE /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:44.761667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.761667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.769187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.769385 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.770180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.770625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.876282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.886166 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0a4d34e6-164d-4e3b-9232-01bfb5ac2172 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.164781 Jul 14 16:01:44.887346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 536/1007] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:44.892178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.892811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.899577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.900033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.900947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.901388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.925381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.939762 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2bed0386-77cc-4030-bdd9-1461fe6cdb5e tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.183148 Jul 14 16:01:44.940597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 472/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:45.040356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.048737 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5cf81ebb-927c-48b3-a5f5-fe7bc223d996 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.160867 Jul 14 16:01:45.049342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 537/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:45.194677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.195295 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.204045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.204502 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.205278 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.205965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.347248 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.355761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.357323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.358512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fb29cd02-be2e-42fd-b394-3ca39f337234 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.169268 Jul 14 16:01:45.359092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 473/1010] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:01:45.623851 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8e9830-a6c1-4ad9-ae37-be5e7da42a26", "name": "network-vif-plugged", "status": "completed", "tag": "9c8671a6-14fb-4aad-8815-94096e9a058a"}, {"server_uuid": "695d9591-7c7f-45a3-8a37-9a4185a535bd", "name": "network-vif-plugged", "status": "completed", "tag": "5d409ea6-43c0-4937-b929-d8042170cd63"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:45.634115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.634620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.648703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] Creating event network-vif-plugged:9c8671a6-14fb-4aad-8815-94096e9a058a for instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 on hv-cinder-83716 Jul 14 16:01:45.649234 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] Creating event network-vif-plugged:5d409ea6-43c0-4937-b929-d8042170cd63 for instance 695d9591-7c7f-45a3-8a37-9a4185a535bd on hv-cinder-83716 Jul 14 16:01:45.655811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-b3c56f95-e7f5-465a-8701-94aee2a16633 req-1000934f-e098-4e49-a87c-e9449c8bdecc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035676 Jul 14 16:01:45.656411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 538/1011] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:45.692101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.692705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.698796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.699244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.700005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.700440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.833908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.841531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ff968917-d34a-4697-9040-b2367d24b937 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.154148 Jul 14 16:01:45.842135 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 474/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:45.905688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.906342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.909459 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:45.913251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.913707 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.914496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.914935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.957874 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.958644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.964892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.965344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.966201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.966645 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.053998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.062286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-17db40c1-b542-4028-a9a3-c8ecae3df765 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.160925 Jul 14 16:01:46.062868 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 539/1013] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:46.067824 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.068421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.074607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.075057 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.075821 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.076254 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.103565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.111961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-dcdc3a21-bbce-475d-9d65-0bc9e3cd0113 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.158873 Jul 14 16:01:46.112644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 475/1014] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:46.211269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.218847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-943de821-941b-473b-af08-abbda2f9761b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.155029 Jul 14 16:01:46.219424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 540/1015] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:46.376979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.377609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.385243 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.385686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.386486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.386922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.520165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.528186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.529731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.530949 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f7c529c6-6ac0-4bac-854a-31aab6c1ae7d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.158224 Jul 14 16:01:46.531507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 476/1016] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:46.860182 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.860740 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.868095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.868628 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.869411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.869878 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.006187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.013712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fe2c6d42-4811-43bd-9638-4edc504b55a7 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.157675 Jul 14 16:01:47.014812 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 541/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:47.080062 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.080799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.087627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.088081 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.088859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.089302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.128828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.129445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.136033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.136496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.137279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.137720 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.256859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.264801 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d3b73155-b0a7-4db0-9a22-287ed081842e tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1358 microversion: 2.1 time: 0.188659 Jul 14 16:01:47.265581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 477/1018] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:47.270608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.271222 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.278546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.284689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.284689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.284689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.286604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:47.301058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.309528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e646ed2d-5390-4644-be28-8b3e9f12bee6 tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.184873 Jul 14 16:01:47.310461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 542/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:47.421916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.431200 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-22656d61-bb98-42e9-b3e3-18bcb629fc94 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.164793 Jul 14 16:01:47.431836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 478/1020] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:47.548842 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.549455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.555588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.556034 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.556797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.557230 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.698665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.707480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.709068 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.710260 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-38827915-6466-4d87-b148-d1268cc95b62 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.165558 Jul 14 16:01:47.710832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 543/1021] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:48.031637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.032297 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.039791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.040608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.041509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.041653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.282221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.282807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.289973 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.290420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.291188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.291620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.418177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.430453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ae0e0b13-6219-4acc-967f-eee6c92a6ce6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.402363 Jul 14 16:01:48.431774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 479/1022] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:48.437715 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.438364 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.445462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.445966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.446796 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.447244 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.460620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.468640 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-71c949aa-648b-4e0d-9ab3-f4808901c322 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1548 microversion: 2.1 time: 0.190275 Jul 14 16:01:48.469229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 544/1023] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:48.474675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.475364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.481909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.482453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.483412 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.483855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.642098 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.650477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-101d27ca-1565-4d81-bdc2-49e837ec1149 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.180202 Jul 14 16:01:48.651236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 545/1024] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:48.655993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.656869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.663950 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.664472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.665309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.665831 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.673301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.682227 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4057effd-f982-4536-8183-cfbb23c3014a tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1522 microversion: 2.1 time: 0.247918 Jul 14 16:01:48.682644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 480/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:48.687527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-fc9b7212-65ce-4459-9a57-1a580dcf7856 req-8546d6f9-1770-4e5f-b1d6-a80516880db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898f0bbf-f711-46da-a57f-3b09e9d9b926", "name": "network-vif-deleted", "tag": "cf23c7f1-ddcd-4709-af66-04c74206d848"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:48.696850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-fc9b7212-65ce-4459-9a57-1a580dcf7856 req-8546d6f9-1770-4e5f-b1d6-a80516880db9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.697324 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-fc9b7212-65ce-4459-9a57-1a580dcf7856 req-8546d6f9-1770-4e5f-b1d6-a80516880db9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.709694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-fc9b7212-65ce-4459-9a57-1a580dcf7856 req-8546d6f9-1770-4e5f-b1d6-a80516880db9 service nova] Creating event network-vif-deleted:cf23c7f1-ddcd-4709-af66-04c74206d848 for instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 on hv-cinder-83716 Jul 14 16:01:48.715205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-fc9b7212-65ce-4459-9a57-1a580dcf7856 req-8546d6f9-1770-4e5f-b1d6-a80516880db9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Jul 14 16:01:48.715972 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 481/1026] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:48.729089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.729889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.736159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.736603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.737366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.737799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.805847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.813990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-928fb548-5f87-4799-abdd-dd4e1e883b87 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1548 microversion: 2.1 time: 0.161610 Jul 14 16:01:48.814890 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 546/1027] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:48.830126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.834482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.835194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Searching by: {'deleted': False, 'project_id': '923fdefb5a7246038c012ee78bf00dc2'} {{(pid=129992) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 16:01:48.842199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.842656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.843432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.843967 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.885231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.895009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.897046 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.898392 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-239902b1-dcd7-4379-bd06-a3b1ed3bbeed tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.173456 Jul 14 16:01:48.898987 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 482/1028] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:01:48.941140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.multi_cell_list [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129992) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 16:01:49.038962 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-24a35593-9f07-4f3e-91bb-2110f8100ede tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212620 Jul 14 16:01:49.042075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 547/1029] 10.222.0.47 () {58 vars in 1124 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:49.050270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.050897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.057182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.057662 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.058496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.058938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.192476 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:49.200294 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-69fc113a-e530-4dc8-bf79-78ce42bfcd25 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1548 microversion: 2.1 time: 0.154388 Jul 14 16:01:49.200881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 483/1030] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:49.448511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.449060 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.455631 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.456085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.456901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.457344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.600470 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:49.611774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fddbcdb6-f2af-411f-93d2-3ab07fc9e39c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1364 microversion: 2.1 time: 0.167050 Jul 14 16:01:49.613294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 548/1031] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:49.669117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.670005 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.677440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.677931 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.678772 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.687973 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.698472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.699162 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.707179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.707633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.708522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.708957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.747209 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.747753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.748284 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 898f0bbf-f711-46da-a57f-3b09e9d9b926 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:49.792724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:49.801841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f3da43e2-514d-49b6-ba2c-7776051e0f2b tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1311 microversion: 2.1 time: 0.107064 Jul 14 16:01:49.802423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 549/1032] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:49.848000 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:49.855962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fe8d7f42-25f5-4167-85c7-8314c618871f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.192334 Jul 14 16:01:49.856548 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 484/1033] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:49.916532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.917200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.924233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.925318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.926285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.926857 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.068224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.076500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.078087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.079287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-695fa24c-ad81-495b-8849-5bafc16c95c4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.166937 Jul 14 16:01:50.079849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 550/1034] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:50.634290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.635299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.645334 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.645783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.651274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.651769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.800603 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.808489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e70510a7-e151-48d4-b0d9-542bc972ca13 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1550 microversion: 2.1 time: 0.181402 Jul 14 16:01:50.809072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 485/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:50.823452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.824079 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.831277 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.831735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.832511 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.832997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.833990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.834483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.840786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.841239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.842065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.842611 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.852653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:50.867123 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.868244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.868244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lazy-loading 'fault' on Instance uuid 898f0bbf-f711-46da-a57f-3b09e9d9b926 {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:50.912553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ca45714ee44a549fd002b4aa13973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fd5c51f544a3db6d0b87e37750e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.920356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9df8abcb-755c-496a-9c69-e571b5ddb46d tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 200 len: 1311 microversion: 2.1 time: 0.100983 Jul 14 16:01:50.920953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 551/1036] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:50.926434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.927048 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.933118 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.933585 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.934375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.934813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.937702 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e42f39f1-2e38-48eb-b285-058a007589b5 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107662 Jul 14 16:01:50.938769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 486/1037] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:51.100398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.100705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:51.101452 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.108704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.109229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.109638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50dfefa8-7f7d-4f49-b559-209c96823e05 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1364 microversion: 2.1 time: 0.187659 Jul 14 16:01:51.110477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.110603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 552/1038] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:51.110705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.371859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:51.380261 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:51.381978 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:51.383165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d8b711d3-eb0c-4060-8d0b-b8d5a7990643 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.288978 Jul 14 16:01:51.383779 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 487/1039] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:51.941594 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.942476 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] [instance: 898f0bbf-f711-46da-a57f-3b09e9d9b926] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.953373 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.954253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.955684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.956695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.976496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] HTTP exception thrown: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Request method failure captured: Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 HTTP/1.1 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxhUXoajOhh3ceVHksOZo9mrBJutckJmhJIeA0AAOAqzhvwYY2Oa7aqCfQvOPi1CHYnXizlJsZjgFaYJ72iXNuHRDRUdJA1kkOeNxnEy1tBVSXiCs4AqVdH1hg9qJlEgV5sF3QgMH7PhkOWWJ-QiJoqNH4nUPM3oQ20nXWLayZ5EEg Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:01:51.978203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_508fd5c51f544a3db6d0b87e37750e01", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/508fd5c51f544a3db6d0b87e37750e01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/508fd5c51f544a3db6d0b87e37750e01"}]}] Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 508fd5c51f544a3db6d0b87e37750e01 Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1721027781 Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 81ca45714ee44a549fd002b4aa13973b Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1721027781-project Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. Jul 14 16:01:51.979873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '898f0bbf-f711-46da-a57f-3b09e9d9b926'} Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:51.980801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. Jul 14 16:01:51.982425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:01:51.983781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] Returning 404 to user: Instance 898f0bbf-f711-46da-a57f-3b09e9d9b926 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:51.983781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7a5b2bb9-3f95-4585-bbb2-832ce1c3ea2c tempest-ServerRescueNegativeTestJSON-1721027781 tempest-ServerRescueNegativeTestJSON-1721027781-project] 10.222.0.47 "GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926" status: 404 len: 111 microversion: 2.1 time: 0.044946 Jul 14 16:01:51.984270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 553/1040] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/898f0bbf-f711-46da-a57f-3b09e9d9b926 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:52.131274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.132893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.143218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.144349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.145701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.146387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.379407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e2e25cf-9dff-435c-a785-d69f28dd6ef9"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:52.382201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.392109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.393194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.394957 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.395508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.404873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.414118 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2c50b667-136b-4108-8ffe-e7547a5381ee tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1554 microversion: 2.1 time: 0.290228 Jul 14 16:01:52.419854 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 488/1041] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1554 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:52.430117 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.430742 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.441456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.442365 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.443496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.444254 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.670639 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.680469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.683380 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.685072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a58cf26f-29fc-413d-93d9-4844a655c28f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1742 microversion: 2.20 time: 0.264092 Jul 14 16:01:52.686567 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 489/1042] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:52.692786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.693518 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.702553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.704461 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.705397 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.706867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.801690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5b7098da-12c7-4094-a9f7-8fa9813a240d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113465 Jul 14 16:01:52.802663 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 490/1043] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:52.807956 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-4b76ae5e-f45f-4280-9e1b-43433e6c188a req-1d946c88-350f-4efc-8d2e-b37fbf933440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8e9830-a6c1-4ad9-ae37-be5e7da42a26", "tag": "9c8671a6-14fb-4aad-8815-94096e9a058a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:52.829555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-4b76ae5e-f45f-4280-9e1b-43433e6c188a req-1d946c88-350f-4efc-8d2e-b37fbf933440 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.830014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-4b76ae5e-f45f-4280-9e1b-43433e6c188a req-1d946c88-350f-4efc-8d2e-b37fbf933440 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.859991 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-4b76ae5e-f45f-4280-9e1b-43433e6c188a req-1d946c88-350f-4efc-8d2e-b37fbf933440 service nova] Creating event network-changed:9c8671a6-14fb-4aad-8815-94096e9a058a for instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 on hv-cinder-83716 Jul 14 16:01:52.872124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-4b76ae5e-f45f-4280-9e1b-43433e6c188a req-1d946c88-350f-4efc-8d2e-b37fbf933440 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068187 Jul 14 16:01:52.873520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 491/1044] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.556531 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3807fd16-4846-4c0d-b683-c005f1f6e27a tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182997 Jul 14 16:01:53.557488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 554/1045] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:01:52 2022] POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.705576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.707904 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.717308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.721182 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.721669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.722157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.201099 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:54.219604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:54.229286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:54.238443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-34f977e9-e670-4423-885f-cea0e802d308 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.536784 Jul 14 16:01:54.240808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 492/1046] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:53 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:54.959867 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-d0f2e878-1bea-4536-862b-cbdcfbde2977 req-217e4954-885e-4c59-8495-477863517422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "name": "network-vif-plugged", "status": "completed", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:54.992440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d0f2e878-1bea-4536-862b-cbdcfbde2977 req-217e4954-885e-4c59-8495-477863517422 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.993169 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d0f2e878-1bea-4536-862b-cbdcfbde2977 req-217e4954-885e-4c59-8495-477863517422 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.025903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-d0f2e878-1bea-4536-862b-cbdcfbde2977 req-217e4954-885e-4c59-8495-477863517422 service nova] Creating event network-vif-plugged:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:01:55.040026 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-d0f2e878-1bea-4536-862b-cbdcfbde2977 req-217e4954-885e-4c59-8495-477863517422 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083721 Jul 14 16:01:55.047279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 555/1047] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:55.132738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-f9467e91-9490-4605-a557-29cb04d84a0d req-b120eca0-aac1-400f-805d-e22938fad60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695d9591-7c7f-45a3-8a37-9a4185a535bd", "tag": "5d409ea6-43c0-4937-b929-d8042170cd63"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:55.162808 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-f9467e91-9490-4605-a557-29cb04d84a0d req-b120eca0-aac1-400f-805d-e22938fad60f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.163869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-f9467e91-9490-4605-a557-29cb04d84a0d req-b120eca0-aac1-400f-805d-e22938fad60f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.182890 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-f9467e91-9490-4605-a557-29cb04d84a0d req-b120eca0-aac1-400f-805d-e22938fad60f service nova] Creating event network-changed:5d409ea6-43c0-4937-b929-d8042170cd63 for instance 695d9591-7c7f-45a3-8a37-9a4185a535bd on hv-cinder-83716 Jul 14 16:01:55.189306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-f9467e91-9490-4605-a557-29cb04d84a0d req-b120eca0-aac1-400f-805d-e22938fad60f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Jul 14 16:01:55.190792 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 493/1048] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:55.259975 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:55.260798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:55.273871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.276540 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.278972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.280194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.631508 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:55.649351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:55.651046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:55.652301 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b924561c-b6c5-4313-b8b2-a57042d3ff4e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.397215 Jul 14 16:01:55.652863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 556/1049] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:55 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:56.694247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.694247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.705891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.706629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.709134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.709867 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.085677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.100173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.102938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.103171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-41ba2ca8-9360-4713-8fa4-0febbe168764 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.433993 Jul 14 16:01:57.109410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 494/1050] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:58.145104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.145972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.153157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.153919 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.156637 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.158300 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.445128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.457901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.460453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.462753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f479404f-c069-44b7-be6c-8aaf2717a372 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.337135 Jul 14 16:01:58.463462 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 557/1051] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:01:59.487510 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:59.488351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.498006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.498995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.499605 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.500229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.698103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.707415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.710347 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.711915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0db6f5dd-3da7-4b1f-b13a-d6436ee353e4 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.231414 Jul 14 16:01:59.712812 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 495/1052] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:01:59 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:00.735220 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.736201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.744735 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:00.747998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.748475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.749638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.750114 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.951717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.964463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.964463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.965244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7a93f4de-2aea-4eee-b1b8-7702093748f3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.235314 Jul 14 16:02:00.966500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 558/1053] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:01.512767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.516007 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.521185 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.521754 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.522635 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.523145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.694058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:01.718301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-cecd89e6-994e-4e85-bdee-9070de9d14d3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1594 microversion: 2.1 time: 0.207354 Jul 14 16:02:01.719133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 496/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1594 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:01.994188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.996621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.026105 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.026856 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.058040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.058040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.297438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:02.304381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:02.315897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:02.317383 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a561fdb2-f5f4-46c4-bd3e-22d8b46121d2 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.336606 Jul 14 16:02:02.328517 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 559/1055] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:03.336446 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:03.337061 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:03.343832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.344281 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.345059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.345520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.363714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=100 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:03.510825 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:03.520139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:03.522310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:03.523693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6c12f1e8-6aa8-49a2-99a9-397e39305f01 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.191275 Jul 14 16:02:03.524453 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 497/1056] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:03 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:04.168244 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-506816d0-2b50-467c-b19e-a2941e5e7c8d tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ffeb9c10>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.227783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-506816d0-2b50-467c-b19e-a2941e5e7c8d tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/223e5c9b-47f5-410b-8c78-32c8b0d0c3ec" status: 200 len: 351 microversion: 2.1 time: 0.070229 Jul 14 16:02:04.229259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 560/1057] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/os-volumes/223e5c9b-47f5-410b-8c78-32c8b0d0c3ec => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:04.543139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.543924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:04.553185 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.553413 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.554126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.554578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.739354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.748883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.750696 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.752298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7bb8712b-b45b-44b6-980f-c439f71db636 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.213696 Jul 14 16:02:04.753094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 498/1058] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:05.784463 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:05.789030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:05.798116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.799048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.800714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.801836 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.844235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-bd8ce905-87d4-4ea8-b7c6-5bb4ff0386f7 req-0c37643e-24a6-47d6-a5c4-02ab549e18fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:05.855243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-bd8ce905-87d4-4ea8-b7c6-5bb4ff0386f7 req-0c37643e-24a6-47d6-a5c4-02ab549e18fd service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.855891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-bd8ce905-87d4-4ea8-b7c6-5bb4ff0386f7 req-0c37643e-24a6-47d6-a5c4-02ab549e18fd service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.871258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-bd8ce905-87d4-4ea8-b7c6-5bb4ff0386f7 req-0c37643e-24a6-47d6-a5c4-02ab549e18fd service nova] Creating event network-changed:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:02:05.878023 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-bd8ce905-87d4-4ea8-b7c6-5bb4ff0386f7 req-0c37643e-24a6-47d6-a5c4-02ab549e18fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297643 Jul 14 16:02:05.884298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 561/1059] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:06.133474 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5431fade-237a-48bc-a568-796ee86747ef tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff552700>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:06.251689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5431fade-237a-48bc-a568-796ee86747ef tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e4615c2e-731c-4fa1-b215-ebb1c6820eef" status: 200 len: 351 microversion: 2.1 time: 0.122530 Jul 14 16:02:06.257927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 562/1060] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:02:06 2022] GET /compute/v2.1/os-volumes/e4615c2e-731c-4fa1-b215-ebb1c6820eef => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:06.303186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.315732 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.323957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.325432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d82e102f-5b02-4302-b232-0dc44c52a3cf tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.555579 Jul 14 16:02:06.337404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 499/1061] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:05 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:07.345697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.346852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.354131 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.354588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.355464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.355907 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.493090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.501711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.503947 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.505056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a6e8e3c1-f3f7-485f-b213-5672abcca6c0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.164525 Jul 14 16:02:07.505619 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 563/1062] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:08.524048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.524764 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.531358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.531821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.532631 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.533240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.681545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.692747 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.694960 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.696837 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5e64c2b2-19c3-4343-a862-cbad8c3dbd90 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1737 microversion: 2.20 time: 0.176772 Jul 14 16:02:08.697988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 500/1063] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:08.932886 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f76378c1-20fa-4ea4-9d15-7c7c794846d9 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ffe52b80>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.983316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f76378c1-20fa-4ea4-9d15-7c7c794846d9 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/024373df-a7e0-43e3-9ecb-f76dcf2edb83" status: 200 len: 350 microversion: 2.1 time: 0.054188 Jul 14 16:02:08.983894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 564/1064] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/os-volumes/024373df-a7e0-43e3-9ecb-f76dcf2edb83 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:08.995576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4ddb9040-7abf-4d77-9e7f-76a2bac39d8d tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff6a5f70>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.082664 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4ddb9040-7abf-4d77-9e7f-76a2bac39d8d tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090819 Jul 14 16:02:09.083299 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 501/1065] 10.222.0.47 () {58 vars in 1133 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.095647 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9711e6d3-1328-4187-9c1b-af949b8e2fe9 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ffee3c10>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.177229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9711e6d3-1328-4187-9c1b-af949b8e2fe9 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085447 Jul 14 16:02:09.177803 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 565/1066] 10.222.0.47 () {58 vars in 1148 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:09.191106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e6efb9cd-a23c-42c1-8c5c-72b77228db0a tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff6da5e0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.274913 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e6efb9cd-a23c-42c1-8c5c-72b77228db0a tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089094 Jul 14 16:02:09.275492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 502/1067] 10.222.0.47 () {58 vars in 1133 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.287500 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b30a5330-a8d0-4221-96e2-be17f0137121 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33fff2b430>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.377904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b30a5330-a8d0-4221-96e2-be17f0137121 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091701 Jul 14 16:02:09.377904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 566/1068] 10.222.0.47 () {58 vars in 1166 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:09.388499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-342108af-7ccf-4c1e-8716-1ea32ef7f8ff tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff7141f0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.480441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-342108af-7ccf-4c1e-8716-1ea32ef7f8ff tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088160 Jul 14 16:02:09.480441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 503/1069] 10.222.0.47 () {58 vars in 1169 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:09.485193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5f830e2a-3334-4c1f-b9fb-7205b139953c tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ffee3c10>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.581272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5f830e2a-3334-4c1f-b9fb-7205b139953c tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099705 Jul 14 16:02:09.581801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 567/1070] 10.222.0.47 () {58 vars in 1154 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.593668 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-aed23484-7286-4899-a757-f96c2a9e3a87 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff644dc0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.693165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-aed23484-7286-4899-a757-f96c2a9e3a87 tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094077 Jul 14 16:02:09.693165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 504/1071] 10.222.0.47 () {58 vars in 1187 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:09.700137 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-291b6dbc-b511-43fe-b42c-c10a41442fcc tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] Calling method '.version_select at 0x7f33ff552c10>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.717093 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.718340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.726450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.726915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.727790 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.728241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.795151 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-291b6dbc-b511-43fe-b42c-c10a41442fcc tempest-VolumesTestJSON-2044133646 tempest-VolumesTestJSON-2044133646-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099810 Jul 14 16:02:09.795766 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 568/1072] 10.222.0.47 () {58 vars in 1154 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.924878 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.933366 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.934950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.936155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3a0b0382-cc82-4871-b557-435d42cde621 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1719 microversion: 2.20 time: 0.224058 Jul 14 16:02:09.936722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 505/1073] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:10.010732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409889773"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:10.016266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.019439 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.019612 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.020326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.020829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.170429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.network.security_group_api [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Adding security group 751b4e4d-cae7-4e22-8416-a520c22e8827 to port 7712455a-3773-4ae7-ad3e-5616bc3be1d7 Jul 14 16:02:10.648146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f54e3a08-29aa-40e5-8ccf-bd84d7e960c7 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action" status: 202 len: 0 microversion: 2.1 time: 0.642021 Jul 14 16:02:10.649158 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 569/1074] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:10 2022] POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:02:10.657757 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.659882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.666544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-30f4479b-0d77-44fa-96ee-d5df09f76f19 req-d6197519-8b41-4a70-8bbe-2b42146121ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:10.667075 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.667707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.668744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.669360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.680927 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-30f4479b-0d77-44fa-96ee-d5df09f76f19 req-d6197519-8b41-4a70-8bbe-2b42146121ce service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.681645 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-30f4479b-0d77-44fa-96ee-d5df09f76f19 req-d6197519-8b41-4a70-8bbe-2b42146121ce service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.695125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-30f4479b-0d77-44fa-96ee-d5df09f76f19 req-d6197519-8b41-4a70-8bbe-2b42146121ce service nova] Creating event network-changed:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:02:10.702942 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-30f4479b-0d77-44fa-96ee-d5df09f76f19 req-d6197519-8b41-4a70-8bbe-2b42146121ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041337 Jul 14 16:02:10.704966 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 570/1075] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:10.859950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:10.870226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fcdedf83-7de7-49b5-95d3-5a7f3203ee68 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1759 microversion: 2.1 time: 0.216657 Jul 14 16:02:10.870821 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 506/1076] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:10.957683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.958871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.966355 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.966906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.967794 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.968343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.124609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.138072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.139441 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.140920 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d58dbc6d-3677-4b9e-a133-0bbfcaca729f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1719 microversion: 2.20 time: 0.188000 Jul 14 16:02:11.152813 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 571/1077] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:12.159460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:12.160086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:12.162975 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:12.167816 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.168512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.169291 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.169737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.401551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.411051 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.423049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.423049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c1f55144-c690-428c-b4e3-2bba1cd70dd3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1719 microversion: 2.20 time: 0.259005 Jul 14 16:02:12.423049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 507/1078] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:12 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1719 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:13.432744 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.433377 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.440246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.440697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.441479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.441959 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.587016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.595514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.597032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.598348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-065d1234-f323-42ec-a7ed-ca59ee79b010 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1662 microversion: 2.20 time: 0.169543 Jul 14 16:02:13.599409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 572/1079] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:13.617619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "729279f7-0360-4c3d-9471-a91af45ca6a4"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:13.618891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.626064 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.626661 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.627432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.627863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.606089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4fa217a3-9c91-4e25-a1c6-beb936b104c6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.992510 Jul 14 16:02:14.606720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 508/1080] 10.222.0.47 () {62 vars in 1363 bytes} [Thu Jul 14 16:02:13 2022] POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments => generated 188 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 16:02:14.759019 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:14.760092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:14.766838 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.767290 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.768261 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.768685 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.814094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-096eb97d-001a-4708-b3ce-05b486834c52 req-8b9e14b2-5385-4d5c-bf57-ab8122832f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "name": "network-vif-unplugged", "status": "completed", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:14.823455 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-096eb97d-001a-4708-b3ce-05b486834c52 req-8b9e14b2-5385-4d5c-bf57-ab8122832f87 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.823893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-096eb97d-001a-4708-b3ce-05b486834c52 req-8b9e14b2-5385-4d5c-bf57-ab8122832f87 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.836012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.compute.server_external_events [req-096eb97d-001a-4708-b3ce-05b486834c52 req-8b9e14b2-5385-4d5c-bf57-ab8122832f87 service nova] Unable to find a host for instance bd039734-918c-4c52-875a-ba68f8ef112d. Dropping event network-vif-unplugged {{(pid=129991) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 16:02:14.836898 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-096eb97d-001a-4708-b3ce-05b486834c52 req-8b9e14b2-5385-4d5c-bf57-ab8122832f87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026606 Jul 14 16:02:14.837789 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 509/1081] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 16:02:15.457387 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d3388133-e3d9-4499-915e-0b21b70ad2a0 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments/729279f7-0360-4c3d-9471-a91af45ca6a4" status: 202 len: 0 microversion: 2.20 time: 0.702126 Jul 14 16:02:15.458041 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 573/1082] 10.222.0.47 () {60 vars in 1456 bytes} [Thu Jul 14 16:02:14 2022] DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments/729279f7-0360-4c3d-9471-a91af45ca6a4 => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:02:15.521660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:15.522265 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.528319 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.528777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.543934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.543934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.841183 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e1cc4a9b-100c-4e33-a586-3905b317bcf5 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/action" status: 202 len: 0 microversion: 2.20 time: 0.323238 Jul 14 16:02:15.843074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 510/1083] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 14 16:02:15 2022] POST /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:02:15.851563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.852190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.859580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.860033 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.861227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.861713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.867093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:16.023590 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.031875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.033432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.034650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-229a66c7-93e3-49e7-8107-1ef401449a6d tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1670 microversion: 2.20 time: 0.187898 Jul 14 16:02:16.035544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 574/1084] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:17.054771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.055380 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.062356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.062802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.063582 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.066780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.215520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.225962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.227362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.228544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bb367bd2-06d9-4666-bd7e-ab221d99f551 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1670 microversion: 2.20 time: 0.177835 Jul 14 16:02:17.229100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 511/1085] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:18.251684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.252371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.254969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=61 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:18.260833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.261325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.262124 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.262558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.401792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.410352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.411853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.413040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b5031e9a-d063-4d85-b71a-96c6ef9cfd50 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.165682 Jul 14 16:02:18.413610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 575/1086] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:19.431903 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.432616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.439332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.439791 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.440575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.441017 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.609070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.620058 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.621919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.623349 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ccf1af1e-e861-4d82-baad-fd453d98e68f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.195336 Jul 14 16:02:19.632781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 512/1087] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:19 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:20.644161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.644970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.652724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.656069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.656069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.656069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.832984 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.849293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.852278 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.854243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-25ff11aa-4591-4924-8b2c-7f35e07ac7e9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.214304 Jul 14 16:02:20.855163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 576/1088] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:21.874181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.874962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.882186 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.882820 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.883827 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.884372 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.030849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.040025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.041895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.043128 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b7854272-83ac-4f26-8cb1-3b2b2cd3db25 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.173095 Jul 14 16:02:22.043693 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 513/1089] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:23.069372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.069372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.071820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.072276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.073318 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.073767 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.258220 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.269104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.270725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.272122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e44c4548-49ea-4217-9d1b-a7265081f768 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.213902 Jul 14 16:02:23.272917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 577/1090] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:24.299699 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.302358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.310534 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.311107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.311979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.312424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.476342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:24.485712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:24.487818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:24.488866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ada245ef-657e-4960-9aaf-fa88ed3ad064 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.195570 Jul 14 16:02:24.490573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 514/1091] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:25.515206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.515206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.517997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.518369 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.519410 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.520144 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.696829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.710655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.713789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.718042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ead1baab-a966-44d4-b2dd-d5400c38727e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.211367 Jul 14 16:02:25.718042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 578/1092] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:25 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:26.738857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:26.739573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:26.748029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.748479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.749255 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.749683 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.754625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:26.960924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.969685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.971363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.972799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-654934fb-fc8c-4b41-8ec3-29a39083e986 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.237694 Jul 14 16:02:26.974187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 515/1093] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:26 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:27.998380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:27.999516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.010633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.011253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.012188 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.012725 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.199177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.209270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.210828 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.212052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5078632a-c508-48f1-b533-49148c66b926 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.222772 Jul 14 16:02:28.212806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 579/1094] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:27 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:29.231389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:29.232257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:29.239929 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.240387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.241172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.241614 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.655979 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:29.667539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:29.670082 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:29.671512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6b0d028e-f802-4fb7-b4ae-b61b081e275b tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.444871 Jul 14 16:02:29.672176 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 516/1095] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:29 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:30.691126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:30.691766 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:30.698362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.698818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.699587 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.700032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.837577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:30.845914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:30.847415 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:30.849069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-813024cd-7c40-4a7f-b1e8-593fc9a1ba09 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.161669 Jul 14 16:02:30.849691 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 580/1096] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:30 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:31.868442 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:31.869052 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:31.876140 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.876600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.877395 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.877846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.011248 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.019792 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.021427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.022648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a2c93772-26bf-43e7-a6da-6f6c60ee6ca6 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.159079 Jul 14 16:02:32.023209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 517/1097] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:31 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:32.526989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:32.528047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.535069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.535525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.536906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.537349 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.796983 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e8ad32cb-5f21-4998-9484-24603b4c3139 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action" status: 202 len: 0 microversion: 2.1 time: 0.273673 Jul 14 16:02:32.798361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 581/1098] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:32 2022] POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:02:32.808107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:32.808743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.815358 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.815806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.816576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.817010 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.991888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.000209 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-30b63819-2d41-4544-8691-c48cb4408cca tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1751 microversion: 2.1 time: 0.196063 Jul 14 16:02:33.001070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 518/1099] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:32 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:33.041394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:33.042136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:33.049595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.050060 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.051111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.051530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.205955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.215331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.216834 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.218097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-68489d90-a2ba-46e3-a389-a3cf1c394303 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.181096 Jul 14 16:02:33.218632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 582/1100] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:33 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:02:34.018829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.019460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.026883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.027211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.027990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.028435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.176509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.184740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6366b16d-560e-4c76-bbe6-0a80c683b355 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.169768 Jul 14 16:02:34.185323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 519/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:34.237040 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.237618 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.244419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.244868 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.245638 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.246107 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.378863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.387621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.389149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.390528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-968e35f3-459a-448f-8020-e5077639bc91 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.157542 Jul 14 16:02:34.391094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 583/1102] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:34.993368 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-6b109ba1-9f35-4a4c-ac3b-9e2ce1355a66 req-2ddee5b6-b04c-4df1-87ff-6e5d4ddd284b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "name": "network-vif-plugged", "status": "completed", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:35.001432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-6b109ba1-9f35-4a4c-ac3b-9e2ce1355a66 req-2ddee5b6-b04c-4df1-87ff-6e5d4ddd284b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.001910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-6b109ba1-9f35-4a4c-ac3b-9e2ce1355a66 req-2ddee5b6-b04c-4df1-87ff-6e5d4ddd284b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.013180 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-6b109ba1-9f35-4a4c-ac3b-9e2ce1355a66 req-2ddee5b6-b04c-4df1-87ff-6e5d4ddd284b service nova] Creating event network-vif-plugged:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:02:35.023069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-6b109ba1-9f35-4a4c-ac3b-9e2ce1355a66 req-2ddee5b6-b04c-4df1-87ff-6e5d4ddd284b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028814 Jul 14 16:02:35.023069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 520/1103] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:35.202189 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:35.202818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:35.210120 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.210574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.211344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.211807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.362525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:35.372286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-79b4e4e0-5a10-45a6-8ae8-35a84a2ce8c9 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.173955 Jul 14 16:02:35.373164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 584/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:35 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:35.410538 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:35.411560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:35.418302 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.418905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.419915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.420351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.562901 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:35.571643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:35.573162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:35.574431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bd734b6c-3ce6-4583-acf9-21119320d77e tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.169137 Jul 14 16:02:35.575015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 521/1105] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:35 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:36.391147 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:36.391763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:36.398719 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.399177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.399946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.400386 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.543895 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.552457 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8deea4bb-6d57-4b0c-9fcf-cf760739b533 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.165123 Jul 14 16:02:36.553269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 585/1106] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:36 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:36.593016 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:36.593749 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:36.600303 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.600758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.601533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.602015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.738226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.746744 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.750832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.750832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6773c19c-24e5-4653-ada7-b7423ead7d72 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.160365 Jul 14 16:02:36.750832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 522/1107] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:36 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:37.569312 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.570010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.576549 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.576998 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.577757 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.578221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.725694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.735923 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-34fe190f-d9e2-472d-9ed6-0950d6f24216 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.170897 Jul 14 16:02:37.736512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 586/1108] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:37.767556 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.768168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.774983 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.775435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.776236 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.776676 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.807787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.808280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.814684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.815211 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.816045 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.816548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.850980 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5c090ae9-0d24-41b5-9e4f-d5bf584d1872 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/ips" status: 200 len: 145 microversion: 2.1 time: 0.047134 Jul 14 16:02:37.856363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 587/1109] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:37.917054 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.925810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.927908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.929095 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d818bd64-1dc2-4f44-878f-2550739906e8 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1728 microversion: 2.20 time: 0.165574 Jul 14 16:02:37.929666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 523/1110] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:38.755628 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:38.756475 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:38.763689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.764149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.764916 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.765358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.914288 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:38.923263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-50ab049b-54ab-4ec7-bc3e-1189407bc414 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.173256 Jul 14 16:02:38.924553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 588/1111] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:38 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:38.950122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:38.950855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:38.962416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.962952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.963752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.964193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.105989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.116403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.118130 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.119382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-55cdbd2f-f9be-4e02-82d0-65f472d48f1c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1715 microversion: 2.20 time: 0.174674 Jul 14 16:02:39.128477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 524/1112] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:02:38 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:02:39.129069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.129069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.129328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.129586 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.131224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.131668 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.158236 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:02:39.180152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:39.542918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5e829d42-07d7-43c3-a679-1258ef3b4c3c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 204 len: 0 microversion: 2.1 time: 0.425875 Jul 14 16:02:39.544018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 589/1113] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:02:39 2022] DELETE /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:02:39.553050 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.553738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.560588 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.560791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afde189d-6817-4249-ba57-20d1717dec28"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:39.561040 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.561811 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.562252 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.562370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.576566 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.576566 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.576913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.577527 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.719504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.728456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fbaf52f3-1e45-4f4f-b5cb-2c0a53c3697f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1574 microversion: 2.1 time: 0.179798 Jul 14 16:02:39.729038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 525/1114] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:39.761591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.762115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.769048 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.769573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.770509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.770959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.797013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f4eb3f24-9dcc-4396-95b4-084b9095c259 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/ips" status: 200 len: 149 microversion: 2.1 time: 0.039324 Jul 14 16:02:39.800860 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 526/1115] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:39.944424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.945555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.953151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.953869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.954477 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.954850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.121007 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:40.129499 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c3e2efda-badf-4cea-9bbb-f4c80b4e55f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.191329 Jul 14 16:02:40.130164 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 527/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:40.752489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:40.753314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:40.760356 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.761059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.761888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.762337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.908483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:40.916797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1f37235a-d4f4-4dd9-b221-86230f6142a1 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1574 microversion: 2.1 time: 0.168232 Jul 14 16:02:40.917370 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 528/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:40 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:41.147917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:41.148624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:41.155268 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.155999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.156950 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.157391 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.329587 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:41.337636 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ed5cc625-57d6-41a6-9228-e55f2aa026b8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.194033 Jul 14 16:02:41.338266 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 529/1118] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:41 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:41.566398 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09723991-2060-4e3b-a5d7-a3c36226c8f6"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:41.568333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:41.576807 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.577512 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.578329 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.578774 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.006970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bba22b73-d168-4115-bc1f-3c854ae326f2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.450137 Jul 14 16:02:42.007583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 590/1119] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:02:39 2022] POST /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 194 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:42.012663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:42.013362 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:42.035595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.036774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.037808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.038675 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.216792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:42.225376 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-95411bd3-a272-448a-9492-041db71102db tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1574 microversion: 2.1 time: 0.216595 Jul 14 16:02:42.226271 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 591/1120] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:42 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:42.354571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:42.355101 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:42.361496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.362001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.362809 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.363256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.527118 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:42.552525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ac1857db-bf67-46d5-85a9-bab7d6efc362 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.199421 Jul 14 16:02:42.553696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 592/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:42 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:42.628452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-72f7c87f-dd6d-4ee2-8d23-696b63597c21 req-88225016-c6d3-486c-9e32-3e11b16aabd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1d5480-e5d1-4ed5-ba9d-185d99c20286", "name": "network-vif-deleted", "tag": "24623b5e-2168-4725-aa9a-7cf93495ac58"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:42.637703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-72f7c87f-dd6d-4ee2-8d23-696b63597c21 req-88225016-c6d3-486c-9e32-3e11b16aabd6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.638729 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-72f7c87f-dd6d-4ee2-8d23-696b63597c21 req-88225016-c6d3-486c-9e32-3e11b16aabd6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.660632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-72f7c87f-dd6d-4ee2-8d23-696b63597c21 req-88225016-c6d3-486c-9e32-3e11b16aabd6 service nova] Creating event network-vif-deleted:24623b5e-2168-4725-aa9a-7cf93495ac58 for instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 on hv-cinder-83716 Jul 14 16:02:42.669910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-bef5d86a-c165-4f10-ba68-0ee51a26df61 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "POST /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111138 Jul 14 16:02:42.676374 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 530/1122] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:02:41 2022] POST /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:42.676993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-72f7c87f-dd6d-4ee2-8d23-696b63597c21 req-88225016-c6d3-486c-9e32-3e11b16aabd6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049365 Jul 14 16:02:42.676993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 593/1123] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:43.245691 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:43.246383 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.254257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.254674 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.256489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.256990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.278509 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:43.326333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:43.335498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1f563b55-60a8-4c59-93c4-ca9c27f7c2b3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 200 len: 1225 microversion: 2.1 time: 0.095289 Jul 14 16:02:43.344886 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 531/1124] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:43 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:43.577553 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:43.578463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.584843 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.585269 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.586116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.586562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.750561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:43.762832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1eb55908-fe1e-4cbc-86cc-879c1b27cecc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.196325 Jul 14 16:02:43.763433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 594/1125] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:43 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:44.352601 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:44.353239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:44.355889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=52 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:44.361068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.361527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.362369 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.362813 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.377644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] HTTP exception thrown: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Request method failure captured: Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 HTTP/1.1 Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D1Kpc0L6MRETEBnxP3xgG3OT1UmxtGn__iPHoweLx1L15zT71vGQxFHThoWqrRmutjS_V1BiAUwm89tECkt3sxYb7wdbA8znftBe5psCoM0lvxODAHqg86OIHbOuDaQqv6-sF3vs4wQwGLdruIpQ9YAqWHd39Vq5V6amJa_NE1RB1U Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:02:44.379507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93233d8a364e44edad9877e1eaa82b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93233d8a364e44edad9877e1eaa82b4d"}]}] Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: ba765c1a8c6c449ca699eb7a44dde50b Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:02:44.381507 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '3f1d5480-e5d1-4ed5-ba9d-185d99c20286'} Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:02:44.382342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:02:44.383670 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:02:44.384829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Returning 404 to user: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:02:44.384829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4720ebf3-3d7b-4d18-bae7-54e53364cc6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 404 len: 111 microversion: 2.1 time: 0.032805 Jul 14 16:02:44.384829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 532/1126] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:44 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:02:44.479948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-758561179", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2067800923", "security_groups": [{"name": "tempest-secgroup-smoke-916256028"}], "block_device_mapping_v2": [{"uuid": "654778f3-7f75-438d-a4f7-8072af857ee3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6678e1c-1ac9-413e-832a-e75939816f1b"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:44.594184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] validate_networks() for [('c6678e1c-1ac9-413e-832a-e75939816f1b', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:02:44.785225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:44.786898 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:44.796829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.801293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.801293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.801293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.969946 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:44.986905 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-697b04da-4223-4d5f-a397-76b4f960741b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.209248 Jul 14 16:02:44.987810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 533/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:44 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:45.009261 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:02:45.009689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:02:45.010205 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:02:45.010620 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:02:45.011039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:02:45.021103 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.022374 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.023178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.023621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.042599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:02:45.047554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for user ba765c1a8c6c449ca699eb7a44dde50b and project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:02:45.107683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:02:45.109764 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='654778f3-7f75-438d-a4f7-8072af857ee3',volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:02:45.602663 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e086cc8b-8bf9-45a5-b2d5-34d3484ef4ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.126616 Jul 14 16:02:45.603345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 595/1128] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:02:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:02:45.613647 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-99515569-baf9-4743-85e5-0a338fc3f1ce tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:45.615145 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-99515569-baf9-4743-85e5-0a338fc3f1ce tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:45.699514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-99515569-baf9-4743-85e5-0a338fc3f1ce tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:45.707789 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-99515569-baf9-4743-85e5-0a338fc3f1ce tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1094 microversion: 2.1 time: 0.097994 Jul 14 16:02:45.708386 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 534/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:45 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:46.004961 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:46.005721 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:46.012800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.014667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.015466 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.015909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.181146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:46.189480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e88093fd-3721-4263-9ff7-83db0d707989 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.188667 Jul 14 16:02:46.190089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 596/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:45 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:46.724637 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:46.725269 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:46.734590 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.735044 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.735831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.736300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.806225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:46.814343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c17e011e-335c-4922-9f7a-714cd24b9015 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1144 microversion: 2.1 time: 0.093620 Jul 14 16:02:46.814920 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 535/1131] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:46 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:47.207467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:47.208263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:47.217116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:47.217582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:47.218635 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:47.218802 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:47.380875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:47.389979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fe1123c3-b17c-4b90-a49d-0de993c627f0 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.186383 Jul 14 16:02:47.390564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 597/1132] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:47 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:47.832775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:47.834865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:47.841941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:47.842403 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:47.843201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:47.843643 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:47.908871 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:47.916665 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ea9f992e-e8d2-4a5d-8c85-9add12dfbe6f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1192 microversion: 2.1 time: 0.088078 Jul 14 16:02:47.917343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 536/1133] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:47 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:48.411213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:48.417524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:48.417524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:48.422024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.423190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.424266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.425544 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.597241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:48.606322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0e8f040b-7a32-42c6-9cfc-3ee3d900fe0c tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.200149 Jul 14 16:02:48.606915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 598/1134] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:48 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:48.934924 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:48.935572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:48.943809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.944267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.945184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.945680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.024304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:49.042745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-72168a9e-2f02-41d4-a9f8-cc1c0fe85fa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1210 microversion: 2.1 time: 0.111711 Jul 14 16:02:49.043423 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 537/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:48 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:49.624224 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:49.624841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:49.632432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.632882 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.633655 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.634122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.775656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:49.776689 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:49.785954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.786340 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.787172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.787618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.798452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:49.807294 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f47bd4ee-8244-4f27-bafc-bd29c975faff tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1756 microversion: 2.1 time: 0.186864 Jul 14 16:02:49.808143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 599/1136] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:49 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:49.821243 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f1afdb65-4f2f-4170-a46f-5c25fc92ffc6 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049559 Jul 14 16:02:49.821831 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 538/1137] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:49 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:49.831946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:49.832449 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:49.839109 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.839559 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.847219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.847219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.871686 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b9fc68b1-5462-41ef-9371-33716d3658ac tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28" status: 200 len: 194 microversion: 2.1 time: 0.043958 Jul 14 16:02:49.872293 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 600/1138] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 14 16:02:49 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:50.061197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:50.061945 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.070440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.071131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.071992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.072511 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.333072 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:50.341327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f8a234ea-6a52-422f-b199-15c3befaa2df tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.284277 Jul 14 16:02:50.341974 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 539/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:50 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:50.825367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:50.826143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.833556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.843013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.843013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.843013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.017649 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:51.027245 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9fd2613a-b883-4c8b-b29f-da81304b965b tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1759 microversion: 2.1 time: 0.205760 Jul 14 16:02:51.027835 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 601/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:50 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1759 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:51.074049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-8dc816f1-fff6-4d11-b729-eb9929594ed3 req-a187e217-3ced-4f6e-9b67-8d192f169bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474f8df-f1f5-4398-8509-01ab192321e9", "tag": "b1731817-9056-4737-b39e-00f943116cba"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:51.088464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8dc816f1-fff6-4d11-b729-eb9929594ed3 req-a187e217-3ced-4f6e-9b67-8d192f169bf2 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.089025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8dc816f1-fff6-4d11-b729-eb9929594ed3 req-a187e217-3ced-4f6e-9b67-8d192f169bf2 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.102810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-8dc816f1-fff6-4d11-b729-eb9929594ed3 req-a187e217-3ced-4f6e-9b67-8d192f169bf2 service nova] Creating event network-changed:b1731817-9056-4737-b39e-00f943116cba for instance 8474f8df-f1f5-4398-8509-01ab192321e9 on hv-cinder-83716 Jul 14 16:02:51.109574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-8dc816f1-fff6-4d11-b729-eb9929594ed3 req-a187e217-3ced-4f6e-9b67-8d192f169bf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039612 Jul 14 16:02:51.110930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 540/1141] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:51.358756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:51.359372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:51.366112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.366569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.367392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.367777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.502733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59696c0b-4ddc-4e2a-854b-1a35cf1f2504"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:51.505129 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:51.512427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.512884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.513926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.514527 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.544388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:51.552911 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-430869ca-961e-45ef-9ea8-84c08648c22f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.198054 Jul 14 16:02:51.553730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 602/1142] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:51 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:52.376300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f529e969-2ab5-446c-8b56-2fb250fc9a57 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "POST /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875479 Jul 14 16:02:52.377169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 541/1143] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 14 16:02:51 2022] POST /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:52.571010 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:52.571618 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:52.578149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.578616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.579412 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.579844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.932044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:52.939806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c577cd34-6e02-41b8-98ec-bde59d69c33b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.373767 Jul 14 16:02:52.940381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 603/1144] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:52 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:53.958010 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:53.958707 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:53.965657 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.966141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.966930 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.967360 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.107692 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:54.115437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c3ec3600-d32b-4581-ad03-e55cd1e1f322 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.162282 Jul 14 16:02:54.116010 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 542/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:53 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:55.133781 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:55.134487 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:55.136897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:55.137577 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=6 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:55.142461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.142946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.143711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.144146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.277473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:55.285213 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ccb18fd1-cd9e-4c28-a21c-afd866478058 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.156684 Jul 14 16:02:55.285791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 604/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:55 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:56.303193 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:56.304376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:56.306829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:56.312224 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.312914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.313694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.314196 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.461740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:56.469900 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d69f793c-ed79-44db-af6f-5ecbf8c18f74 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.170635 Jul 14 16:02:56.470473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 543/1147] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:56 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:56.957445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:56.959041 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:56.965333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.965783 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.966683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.967125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.969728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.051987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'services' on Instance uuid 695d9591-7c7f-45a3-8a37-9a4185a535bd {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:02:57.267961 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-dca5ea25-cd79-4b63-aadd-d0e5fa48ae78 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments/09723991-2060-4e3b-a5d7-a3c36226c8f6" status: 202 len: 0 microversion: 2.1 time: 0.314294 Jul 14 16:02:57.268873 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 605/1148] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:02:56 2022] DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments/09723991-2060-4e3b-a5d7-a3c36226c8f6 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:02:57.278826 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:57.279857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.287177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.287626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.297608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.297608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.320771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6d5ab490-11bb-4b66-9160-454f2e5723b9 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Jul 14 16:02:57.321480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 544/1149] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:57 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:57.487603 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:57.488305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.494657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.495058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.495820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.496262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.636477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:57.644850 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9ddc7684-790d-4a5c-8b0e-e83e9c3c675a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1277 microversion: 2.1 time: 0.161472 Jul 14 16:02:57.645444 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 606/1150] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:57 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:58.332489 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:58.333379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:58.340118 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.340638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.341462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.341938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.374091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1b5f9ce4-2676-4804-94d0-41a5a178ab03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Jul 14 16:02:58.374672 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 545/1151] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:58 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:58.661962 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:58.662481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:58.670076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.670528 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.671280 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.671712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.812419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:58.819981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d8ee2ef1-21b8-4358-8db5-fa1e568324bb tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.161867 Jul 14 16:02:58.820666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 607/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:58 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:59.386694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.387535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.394536 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.394989 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.395809 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.396239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.436373 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-35f688e0-2a2f-4a30-8a18-3e73b2cf5600 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053753 Jul 14 16:02:59.437063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 546/1153] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:59.839263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.839872 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.846648 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.847085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.847852 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.848282 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.996961 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:00.004570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bd2a0841-d44f-4b35-b6d7-5b6e54dc3f44 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.169855 Jul 14 16:03:00.005150 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 608/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:00.449470 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:00.451690 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:00.458701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.459085 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.459908 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.460344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.491432 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d6805fde-2c78-4195-a1e8-2ed1ebfe0ae0 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047140 Jul 14 16:03:00.492013 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 547/1155] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:00 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:01.022407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:01.023024 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:01.029697 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.030185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.030963 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.031408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.185301 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:01.193303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-84386929-04ed-4340-9c4b-047ce3dc56ae tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.174762 Jul 14 16:03:01.193905 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 609/1156] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:01 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:01.502494 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:01.503524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:01.510391 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.511599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.511599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.512121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.547338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4b1163e1-6243-463f-9821-3654a1dc8389 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Jul 14 16:03:01.551541 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 548/1157] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:01 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:02.211452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.212083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:02.219441 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.219951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.220731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.221170 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.368111 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:02.380429 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-32a05f3a-023c-4cab-a318-083018d8f389 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.172615 Jul 14 16:03:02.381525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 610/1158] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:02 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:02.560404 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.561887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:02.570122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.570122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.570122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.570530 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.585549 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:02.603578 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4b5de23f-103d-4e60-83a0-948defa3c2b6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048227 Jul 14 16:03:02.604941 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 549/1159] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:02 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:03.399200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:03.399915 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:03.410087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.410087 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.410467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.410736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.566070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:03.574808 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-48b4d485-603c-44a1-a4d6-b9c969b67407 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.179505 Jul 14 16:03:03.575401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 611/1160] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:03 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:03.615516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:03.616450 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:03.624300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.624759 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.625539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.626014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.659057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-486d3098-ad7f-43b1-8f84-44ffd5a4163d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047582 Jul 14 16:03:03.659907 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 550/1161] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:03 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:04.594558 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:04.595160 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:04.601994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.602452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.603235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.603677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.671501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:04.673463 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:04.681029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.681480 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.682797 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.683237 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.716163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4a62e2af-178d-46ce-aa8a-43fbcf780702 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048977 Jul 14 16:03:04.716795 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 551/1162] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:04 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:04.751219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:04.759604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7d880470-f114-4bb0-8b44-524a2cdc5307 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.168883 Jul 14 16:03:04.761142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 612/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:04 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:05.728494 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:05.729427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:05.736306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.736751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.737520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.738065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.768427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1d5bc49d-516e-496b-9ee9-f1990fc6165f tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Jul 14 16:03:05.769002 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 552/1164] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:05 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:05.778128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:05.778742 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:05.785903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.786361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.787163 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.787614 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.925181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:05.932843 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-174c2104-a136-40a4-a249-301f67442a39 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.159446 Jul 14 16:03:05.933427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 613/1165] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:05 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:06.272393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.273316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.279984 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.280435 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.281205 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.281720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.312756 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3036fe02-b447-477b-ac65-63aeb4e5df3c tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044258 Jul 14 16:03:06.313445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 553/1166] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:06.481724 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.482152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.488897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.489375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.490161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.490599 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.523216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5ace7ff6-a82b-4059-93a0-31fb9fcf0d86 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28" status: 200 len: 194 microversion: 2.1 time: 0.045497 Jul 14 16:03:06.523811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 614/1167] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:06.534859 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.535351 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.542059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.542602 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.543460 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.544006 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.630966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lazy-loading 'services' on Instance uuid fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:06.780611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.782506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.789611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.790192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.791028 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.791580 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.823545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e25568a8-ca88-4baf-8594-a6cf1862ecb6 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047036 Jul 14 16:03:06.824117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 615/1168] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:06.915980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9c63956f-afe3-440c-9e58-4aaa9724a711 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28" status: 202 len: 0 microversion: 2.1 time: 0.384861 Jul 14 16:03:06.916604 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 554/1169] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:03:06 2022] DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/afde189d-6817-4249-ba57-20d1717dec28 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:06.951090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.951921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.958703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.959161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.959938 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.960443 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.130149 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:07.151348 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-748e2692-f533-4ecb-a5a6-cb868a497ef6 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.204704 Jul 14 16:03:07.152453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 616/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:07.847572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:07.847572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:07.856068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.856891 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.858253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.865595 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.902016 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-95f366fd-b2fe-481b-9695-9aaaa17abe03 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061438 Jul 14 16:03:07.902016 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 555/1171] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:07 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:03:07.960051 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:07.960672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:07.967833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.968297 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.969126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.969574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.996985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:08.168619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:08.169896 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:08.176623 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.177035 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.177788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.178257 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.323763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:08.332517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f32e4899-f039-458b-8e46-65336559b1af tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.167760 Jul 14 16:03:08.338052 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 556/1172] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:08 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:08.360463 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-86533d10-0cda-42ab-9631-2dcb0fa0813d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 204 len: 0 microversion: 2.1 time: 0.404381 Jul 14 16:03:08.361713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 617/1173] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:07 2022] DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:03:08.380535 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:08.381240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:08.388379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.388829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.389609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.390070 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.536591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:08.544337 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c7a0a0f3-668b-493d-9da2-55bc55625f74 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1678 microversion: 2.1 time: 0.167776 Jul 14 16:03:08.544915 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 557/1174] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:08 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:09.097039 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.097651 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.105047 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.109657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.109657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.109657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.138050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b6e095b2-52cd-4e90-9b2d-b919261b4009 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/59696c0b-4ddc-4e2a-854b-1a35cf1f2504" status: 200 len: 194 microversion: 2.1 time: 0.045538 Jul 14 16:03:09.138666 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 618/1175] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/59696c0b-4ddc-4e2a-854b-1a35cf1f2504 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:09.148747 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.149310 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.170959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.171619 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.172621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.173057 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.225760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-878068ed-d43d-42a0-b2b7-5e56d5c8216e req-aa823bb6-d046-429e-b9c7-30332aefad2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8474f8df-f1f5-4398-8509-01ab192321e9", "name": "network-vif-plugged", "status": "completed", "tag": "b1731817-9056-4737-b39e-00f943116cba"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:09.238097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-878068ed-d43d-42a0-b2b7-5e56d5c8216e req-aa823bb6-d046-429e-b9c7-30332aefad2d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.238849 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-878068ed-d43d-42a0-b2b7-5e56d5c8216e req-aa823bb6-d046-429e-b9c7-30332aefad2d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.253358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-878068ed-d43d-42a0-b2b7-5e56d5c8216e req-aa823bb6-d046-429e-b9c7-30332aefad2d service nova] Creating event network-vif-plugged:b1731817-9056-4737-b39e-00f943116cba for instance 8474f8df-f1f5-4398-8509-01ab192321e9 on hv-cinder-83716 Jul 14 16:03:09.258886 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-878068ed-d43d-42a0-b2b7-5e56d5c8216e req-aa823bb6-d046-429e-b9c7-30332aefad2d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037133 Jul 14 16:03:09.259644 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 619/1176] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:09.276758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lazy-loading 'services' on Instance uuid fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:09.352056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.352778 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.360328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.360792 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.361569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.362046 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.366914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:09.510949 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:09.518646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0bdc5596-f9a5-4afc-968e-260e6fc832ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.171310 Jul 14 16:03:09.519239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 620/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:09.558789 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7adae413-72f7-48d1-90a1-e2fad9049f29 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/59696c0b-4ddc-4e2a-854b-1a35cf1f2504" status: 202 len: 0 microversion: 2.1 time: 0.413865 Jul 14 16:03:09.559594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 558/1178] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:03:09 2022] DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments/59696c0b-4ddc-4e2a-854b-1a35cf1f2504 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:09.562928 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.563516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.570583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.571170 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.571953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.572934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.732987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:09.740613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bd49584a-5de8-48ec-a22a-b7d408346faa tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1678 microversion: 2.1 time: 0.182979 Jul 14 16:03:09.741190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 621/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:10.539539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.540331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.549359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.549359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.549359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.549359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.724505 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:10.733475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7d6f6471-2d1e-4168-9fe6-cfc60edcb052 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.199960 Jul 14 16:03:10.737981 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 559/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:10.759922 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.760633 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.767001 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.767453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.768246 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.770613 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.921171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:10.929102 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-564a0580-2d84-449e-a03a-df9e350412be tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1678 microversion: 2.1 time: 0.173293 Jul 14 16:03:10.929689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 622/1181] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:11.751752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.751752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.758464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.758917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.759717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.760155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.827780 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.829353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.836131 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.840667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.840667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.840667 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.871565 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c849f354-bb34-4cfb-b10b-5162feaa5939 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047500 Jul 14 16:03:11.872268 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 623/1182] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 16:03:11.956072 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.958888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.983935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.985012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.986439 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.987595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.001245 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.015856 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7300e9e0-f06c-4ee5-9fef-ed81a0a5bc60 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1265 microversion: 2.1 time: 0.268240 Jul 14 16:03:12.022914 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 560/1183] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:12.050597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.051609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.072203 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.072731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.073895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.074346 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.106414 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.115636 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e2a34f6e-0a8f-468f-9ec9-846d191a7a42 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1613 microversion: 2.1 time: 0.168128 Jul 14 16:03:12.117438 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 624/1184] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:12.117547 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ad05ab50-fbbb-42fe-a06a-2c09085134bb tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071172 Jul 14 16:03:12.117996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 561/1185] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:03:12.122222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-d8fcc032-0784-446f-b344-b3d8e692f798 req-109540a6-12e9-4072-b739-5201f507593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d9591-7c7f-45a3-8a37-9a4185a535bd", "name": "network-vif-deleted", "tag": "5d409ea6-43c0-4937-b929-d8042170cd63"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:12.131897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d8fcc032-0784-446f-b344-b3d8e692f798 req-109540a6-12e9-4072-b739-5201f507593d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.132723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-d8fcc032-0784-446f-b344-b3d8e692f798 req-109540a6-12e9-4072-b739-5201f507593d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.147433 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-d8fcc032-0784-446f-b344-b3d8e692f798 req-109540a6-12e9-4072-b739-5201f507593d service nova] Creating event network-vif-deleted:5d409ea6-43c0-4937-b929-d8042170cd63 for instance 695d9591-7c7f-45a3-8a37-9a4185a535bd on hv-cinder-83716 Jul 14 16:03:12.153570 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-d8fcc032-0784-446f-b344-b3d8e692f798 req-109540a6-12e9-4072-b739-5201f507593d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Jul 14 16:03:12.154522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 625/1186] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:12.195487 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.196331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.203767 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.204316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.205344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.205786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.236610 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:12.401316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:12.609412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ea5bf5e1-0f67-4ecb-8c31-59777e24d249 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 204 len: 0 microversion: 2.1 time: 0.417754 Jul 14 16:03:12.610327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 562/1187] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:12 2022] DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:03:12.622785 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.623700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.631496 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.632925 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.633733 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.634394 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.785283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.793777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1b19c127-5533-4c0b-83fa-1ef65c5c4eaf tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1674 microversion: 2.1 time: 0.178468 Jul 14 16:03:12.794397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 626/1188] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:13.034298 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.035628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.044038 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.044506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.045602 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.046162 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.133407 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.134104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.141128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.142361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.143344 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.143988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.182090 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.183465 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.183788 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 695d9591-7c7f-45a3-8a37-9a4185a535bd {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:13.202581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.211079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e655227f-9a98-4619-b744-3b4ebd21d862 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1452 microversion: 2.1 time: 0.181453 Jul 14 16:03:13.211877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 563/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:13.227763 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.228382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.233042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.235484 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.236138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.236719 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.237339 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.246082 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-390181dc-a684-4c88-8ef9-cc3899755038 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1331 microversion: 2.1 time: 0.116080 Jul 14 16:03:13.246955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 627/1190] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:13.381686 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.389335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6f24055d-6eec-43d5-999a-8e7d40606971 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1452 microversion: 2.1 time: 0.165612 Jul 14 16:03:13.391609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 564/1191] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:13.811914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.812571 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.818952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.819424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.820215 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.820833 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.002434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.010351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3201ab36-0267-498b-bdbd-2f5dc4b11780 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1674 microversion: 2.1 time: 0.202242 Jul 14 16:03:14.011489 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 628/1192] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:14.266597 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.268546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.275251 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.275887 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.280086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.280086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.311688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.312884 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.313387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 695d9591-7c7f-45a3-8a37-9a4185a535bd {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:14.358709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.366374 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7a3bf752-f850-4dea-940a-f645f47a8e67 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1331 microversion: 2.1 time: 0.103735 Jul 14 16:03:14.366968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 565/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:14 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:15.030900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.032203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.052397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.053045 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.053607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.054069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.305741 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:15.314404 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cc07aa0f-7564-40f0-8199-e66a9bd1c938 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1674 microversion: 2.1 time: 0.289971 Jul 14 16:03:15.314985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 629/1194] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1674 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:15.384687 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.385559 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.388074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:15.393028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.393495 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.395975 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.395975 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.433290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.433290 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.433624 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lazy-loading 'fault' on Instance uuid 695d9591-7c7f-45a3-8a37-9a4185a535bd {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:15.476862 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fd1155ff11417db8c647f0aadf74a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975f7cf0a1f5445cb45ea441b3c056d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:15.488238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d39e88ca-8c96-496d-8f57-181afeb54e4a tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 200 len: 1331 microversion: 2.1 time: 0.107048 Jul 14 16:03:15.488917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 566/1195] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:15.747952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-b19ea4c0-c831-4817-b8d4-33b1df639df8 req-65095a4e-ed1b-49c0-9ba0-3365fcc78d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474f8df-f1f5-4398-8509-01ab192321e9", "tag": "b1731817-9056-4737-b39e-00f943116cba"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:15.756656 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b19ea4c0-c831-4817-b8d4-33b1df639df8 req-65095a4e-ed1b-49c0-9ba0-3365fcc78d2f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.757095 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-b19ea4c0-c831-4817-b8d4-33b1df639df8 req-65095a4e-ed1b-49c0-9ba0-3365fcc78d2f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.769447 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-b19ea4c0-c831-4817-b8d4-33b1df639df8 req-65095a4e-ed1b-49c0-9ba0-3365fcc78d2f service nova] Creating event network-changed:b1731817-9056-4737-b39e-00f943116cba for instance 8474f8df-f1f5-4398-8509-01ab192321e9 on hv-cinder-83716 Jul 14 16:03:15.774823 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-b19ea4c0-c831-4817-b8d4-33b1df639df8 req-65095a4e-ed1b-49c0-9ba0-3365fcc78d2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030589 Jul 14 16:03:15.775427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 630/1196] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:16.333089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.334092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.341049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.341757 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.342745 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.343354 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.453564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:16.467889 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6e778e8f-f29a-4ef1-b3f9-1d79af4d86b1 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1606 microversion: 2.1 time: 0.138752 Jul 14 16:03:16.469545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 567/1197] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1606 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:16.511604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.512452 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.526498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.527266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.529070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.529853 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.551370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd HTTP/1.1 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:16.554286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:16.555684 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '695d9591-7c7f-45a3-8a37-9a4185a535bd'} Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:16.556473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:16.558713 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:16.570375 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:16.571734 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-aa737f42-7adf-4de4-a1f5-7d1311aaf34d tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 404 len: 111 microversion: 2.1 time: 0.067758 Jul 14 16:03:16.573184 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 631/1198] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:16.581953 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-139a0560-dbb7-406a-96f8-cec45a19df38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '.version_select at 0x7f33ff48caf0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.787600 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-139a0560-dbb7-406a-96f8-cec45a19df38 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-103466588" status: 202 len: 0 microversion: 2.1 time: 0.209532 Jul 14 16:03:16.788259 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 568/1199] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 14 16:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-103466588 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:16.905525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-924269b9-c1ab-49ec-b27f-c105a90bdcb2 req-04087c13-6b30-40be-81d8-2712c9521f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8e9830-a6c1-4ad9-ae37-be5e7da42a26", "name": "network-vif-deleted", "tag": "9c8671a6-14fb-4aad-8815-94096e9a058a"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:16.916017 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-924269b9-c1ab-49ec-b27f-c105a90bdcb2 req-04087c13-6b30-40be-81d8-2712c9521f65 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.916522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-924269b9-c1ab-49ec-b27f-c105a90bdcb2 req-04087c13-6b30-40be-81d8-2712c9521f65 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.945194 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-924269b9-c1ab-49ec-b27f-c105a90bdcb2 req-04087c13-6b30-40be-81d8-2712c9521f65 service nova] Creating event network-vif-deleted:9c8671a6-14fb-4aad-8815-94096e9a058a for instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 on hv-cinder-83716 Jul 14 16:03:16.960412 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-924269b9-c1ab-49ec-b27f-c105a90bdcb2 req-04087c13-6b30-40be-81d8-2712c9521f65 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059001 Jul 14 16:03:16.961473 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 632/1200] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:17.487634 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.488430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.497069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.497524 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.499084 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.499532 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.551458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.551458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.551458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lazy-loading 'fault' on Instance uuid fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:17.582074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdbbbf1b9944b09898fa8731184c845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a86c4d5f1043ca93987ed2c77a3629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:17.591231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-beff48e5-cc05-4ce3-acc1-05402dd53628 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 200 len: 1328 microversion: 2.1 time: 0.109089 Jul 14 16:03:17.592015 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 569/1201] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:18.611117 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.611956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.618773 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.619227 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.619997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.621016 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.634551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 HTTP/1.1 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:18.636765 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:18.641392 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'fd8e9830-a6c1-4ad9-ae37-be5e7da42a26'} Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:18.642339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:18.643728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:18.645154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:18.645154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2d504d67-85c0-4cba-b68c-039517e842a2 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 404 len: 111 microversion: 2.1 time: 0.031990 Jul 14 16:03:18.645154 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 633/1202] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:03:18.650773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7e0d6747-bf06-4383-8870-860ca9abab5b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '.version_select at 0x7f33ff72c040>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.801503 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7e0d6747-bf06-4383-8870-860ca9abab5b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035652997" status: 202 len: 0 microversion: 2.1 time: 0.154489 Jul 14 16:03:18.806177 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 570/1203] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 14 16:03:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035652997 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:19.280595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.281104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.287732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.288197 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.288969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.289411 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.304287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd HTTP/1.1 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:19.305899 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.307554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '695d9591-7c7f-45a3-8a37-9a4185a535bd'} Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:19.309119 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.318390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.320058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:19.320058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1ab75f06-d43a-43b7-8d38-a40379eeab39 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jul 14 16:03:19.320058 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 634/1204] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:19 2022] DELETE /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:19.325171 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.325799 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 695d9591-7c7f-45a3-8a37-9a4185a535bd] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.332425 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.332616 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.333331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.333781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.348235 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd HTTP/1.1 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:19.349966 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.351628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '695d9591-7c7f-45a3-8a37-9a4185a535bd'} Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:19.356036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. Jul 14 16:03:19.357768 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:19.359579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 695d9591-7c7f-45a3-8a37-9a4185a535bd could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:19.359579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-b11b4978-bd1b-4778-a6ab-a15dd8b30b50 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd" status: 404 len: 111 microversion: 2.1 time: 0.030174 Jul 14 16:03:19.359579 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 571/1205] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/695d9591-7c7f-45a3-8a37-9a4185a535bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:20.705486 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.706059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.708560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:20.720031 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.720479 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.721425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.721914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.741100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a HTTP/1.1 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:20.742986 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.744499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '33bd946f-13d5-4770-902b-142bc1dfb76a'} Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:20.745241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.752806 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.754953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:20.754953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d8559531-53a7-431c-981f-e4fa65cf335b tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 404 len: 111 microversion: 2.1 time: 0.043349 Jul 14 16:03:20.754953 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 635/1206] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:20 2022] DELETE /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:20.764803 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.765359 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 33bd946f-13d5-4770-902b-142bc1dfb76a] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.772274 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.772732 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.773553 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.774037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a HTTP/1.1 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:20.797644 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.799819 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '33bd946f-13d5-4770-902b-142bc1dfb76a'} Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:20.801165 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. Jul 14 16:03:20.803047 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.804431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 33bd946f-13d5-4770-902b-142bc1dfb76a could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:20.804431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-923d138e-523e-454a-a244-4d100889e2ba tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a" status: 404 len: 111 microversion: 2.1 time: 0.048783 Jul 14 16:03:20.804431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 572/1207] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/33bd946f-13d5-4770-902b-142bc1dfb76a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:03:20.806972 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.807596 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.813736 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.814303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.815082 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.815557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.831380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: DELETE /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 HTTP/1.1 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:20.832948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.834541 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'dd607e1d-a8e4-4d78-9624-ca81454a3b76'} Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:20.836032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.837784 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.840363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:20.840363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b815ac42-67cb-4c25-923a-a992e54372c3 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 404 len: 111 microversion: 2.1 time: 0.031545 Jul 14 16:03:20.840363 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 636/1208] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:20 2022] DELETE /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:20.844660 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.845300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: dd607e1d-a8e4-4d78-9624-ca81454a3b76] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.852189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.852677 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.855151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.855151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.868387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 HTTP/1.1 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:20.870155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.871655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'dd607e1d-a8e4-4d78-9624-ca81454a3b76'} Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:20.873333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. Jul 14 16:03:20.902621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:20.904262 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance dd607e1d-a8e4-4d78-9624-ca81454a3b76 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:20.904262 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-1351c28b-1433-4c8c-98b2-0692ee6704e8 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76" status: 404 len: 111 microversion: 2.1 time: 0.031303 Jul 14 16:03:20.904262 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 573/1209] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/dd607e1d-a8e4-4d78-9624-ca81454a3b76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:21.060811 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.061739 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.070855 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.071315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.072080 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.072552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.107472 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5af9decd-59f2-4d71-8346-f04b0794c33f tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051276 Jul 14 16:03:21.108262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 637/1210] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.230173 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.230773 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.236940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.237430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.238249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.238877 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.266741 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:03:21.656451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f19397c1-fcfb-430c-9844-21a3ddff5c95 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 204 len: 0 microversion: 2.20 time: 0.429942 Jul 14 16:03:21.657092 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 574/1211] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 14 16:03:21 2022] DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:03:21.665991 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.666631 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.673478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.674203 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.674760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.675199 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.834798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.845951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.845951 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.847215 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ee0bc0aa-ca8d-4ac7-9ebb-91a613c56071 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.185810 Jul 14 16:03:21.847777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 638/1212] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:03:22.294537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.295136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.304421 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.305134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.305942 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.306504 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.321853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 HTTP/1.1 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:22.324045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.325675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '868856cc-c674-43d8-bd8d-3e579171b462'} Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:22.329786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.331508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.333223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:22.333223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9869d094-3e35-48bb-a657-a0289f631b89 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 404 len: 111 microversion: 2.1 time: 0.035318 Jul 14 16:03:22.333223 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 575/1213] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:22 2022] DELETE /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:22.336217 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.336908 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] [instance: 868856cc-c674-43d8-bd8d-3e579171b462] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.343820 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.344273 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.345104 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.345575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.360357 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] HTTP exception thrown: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Request method failure captured: Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 HTTP/1.1 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxgx2mvj50HbdgSpJ-O-e7FHxxZqce6R1dmOUrLuqsOymlUf4PeAK4ohiInv6qVRt38ND6I9w0CG2SCeL6Fo0hLB3LeIwjOLFLKnJi2YXi2QTEAK8iNE5Jfl1NymhKPdSCucYqma4X7oh8eo9rehua9RgXZZrVk0U6HYNclEHK7XyQ Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:22.362970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_975f7cf0a1f5445cb45ea441b3c056d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/975f7cf0a1f5445cb45ea441b3c056d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/975f7cf0a1f5445cb45ea441b3c056d5"}]}] Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 975f7cf0a1f5445cb45ea441b3c056d5 Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1957429336 Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: c4fd1155ff11417db8c647f0aadf74a1 Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeNegativeTest-1957429336-project Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.366688 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '868856cc-c674-43d8-bd8d-3e579171b462'} Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:22.367700 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. Jul 14 16:03:22.369219 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.378524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] Returning 404 to user: Instance 868856cc-c674-43d8-bd8d-3e579171b462 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:22.378524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-da0b3728-0000-4767-ac0b-97d822756675 tempest-AttachVolumeNegativeTest-1957429336 tempest-AttachVolumeNegativeTest-1957429336-project] 10.222.0.47 "GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462" status: 404 len: 111 microversion: 2.1 time: 0.033760 Jul 14 16:03:22.378524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 639/1214] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/868856cc-c674-43d8-bd8d-3e579171b462 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:22.422389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.423053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.430169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.430800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.431783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.432333 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.447724 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 HTTP/1.1 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:22.449846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.451555 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'fd8e9830-a6c1-4ad9-ae37-be5e7da42a26'} Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:22.456474 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.458167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.460247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:22.460247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5d0e99d3-4366-46c1-b67a-8dfce33017b8 tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 404 len: 111 microversion: 2.1 time: 0.034103 Jul 14 16:03:22.460247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 576/1215] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:22 2022] DELETE /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:22.463152 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.464728 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: fd8e9830-a6c1-4ad9-ae37-be5e7da42a26] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.471977 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.472624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.473582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.474251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.489965 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 HTTP/1.1 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:22.491610 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.493285 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'fd8e9830-a6c1-4ad9-ae37-be5e7da42a26'} Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:22.494272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. Jul 14 16:03:22.496283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:22.497897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:22.497897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4c9174ea-3ae0-4b66-a968-693c35d6296b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26" status: 404 len: 111 microversion: 2.1 time: 0.038052 Jul 14 16:03:22.497897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 640/1216] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/fd8e9830-a6c1-4ad9-ae37-be5e7da42a26 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:22.866737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.867355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.879028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.879028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.879028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.879028 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.208112 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.217240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.218798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.219991 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6b713520-ec69-407b-943f-6a6f6e0571c9 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.357837 Jul 14 16:03:23.220556 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 577/1217] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:03:23.844266 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.844944 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.851222 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.851672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.852445 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.852906 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.867979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 HTTP/1.1 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:23.869545 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.873256 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'c14712f2-30e1-4219-a304-3769e1912a99'} Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:23.874179 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.875710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.877085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:23.877085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3ac1ad9c-7834-457a-be93-007080451d9a tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 404 len: 111 microversion: 2.1 time: 0.031289 Jul 14 16:03:23.877085 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 641/1218] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:03:23 2022] DELETE /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:23.881330 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.882079 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] [instance: c14712f2-30e1-4219-a304-3769e1912a99] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.889348 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.889922 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.890788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.891669 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.906910 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] HTTP exception thrown: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Request method failure captured: Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 HTTP/1.1 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0DxZ8RlahiyBNhZufWqf_RNbBXLYGM_6Sxt1nW-y9UCU8lkGZFkeA_os8399jYqcwBLBslnNuFILEzcTbCHdve9_oqdgsHPK-xzZnaWkOphMWzTUI_i8TNxG4zd8ay4fabPAMhOADx3rMbWz8bh8g5iSYPStMcDDTJNmr5xVUcjToZg Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:23.908531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_64a86c4d5f1043ca93987ed2c77a3629", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/64a86c4d5f1043ca93987ed2c77a3629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/64a86c4d5f1043ca93987ed2c77a3629"}]}] Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 64a86c4d5f1043ca93987ed2c77a3629 Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-758973649 Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: dcdbbbf1b9944b09898fa8731184c845 Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeTestJSON-758973649-project Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.910202 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'c14712f2-30e1-4219-a304-3769e1912a99'} Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:23.914486 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. Jul 14 16:03:23.916264 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:23.917861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] Returning 404 to user: Instance c14712f2-30e1-4219-a304-3769e1912a99 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:23.917861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4c717161-dc33-4e13-b6b9-6163c1fc756b tempest-AttachVolumeTestJSON-758973649 tempest-AttachVolumeTestJSON-758973649-project] 10.222.0.47 "GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99" status: 404 len: 111 microversion: 2.1 time: 0.033008 Jul 14 16:03:23.917861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 578/1219] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/c14712f2-30e1-4219-a304-3769e1912a99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:24.239904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:24.240623 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:24.247617 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.248067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.248864 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.249331 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.586467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.597241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.599364 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.600595 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b98fbdc0-4515-4099-a690-df7e1196decb tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1721 microversion: 2.20 time: 0.365633 Jul 14 16:03:24.601241 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 642/1220] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:24 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:03:25.234927 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-39939a0c-2866-4520-bbd0-2a02d0bfd51e req-bef0c9c5-c04e-4150-9473-fce02a6929b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd039734-918c-4c52-875a-ba68f8ef112d", "name": "network-vif-deleted", "tag": "16af772d-8197-4fc0-b887-45dc4117109a"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:25.249955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-39939a0c-2866-4520-bbd0-2a02d0bfd51e req-bef0c9c5-c04e-4150-9473-fce02a6929b9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.250830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-39939a0c-2866-4520-bbd0-2a02d0bfd51e req-bef0c9c5-c04e-4150-9473-fce02a6929b9 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.292475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-39939a0c-2866-4520-bbd0-2a02d0bfd51e req-bef0c9c5-c04e-4150-9473-fce02a6929b9 service nova] Creating event network-vif-deleted:16af772d-8197-4fc0-b887-45dc4117109a for instance bd039734-918c-4c52-875a-ba68f8ef112d on hv-cinder-83716 Jul 14 16:03:25.306988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-39939a0c-2866-4520-bbd0-2a02d0bfd51e req-bef0c9c5-c04e-4150-9473-fce02a6929b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079503 Jul 14 16:03:25.308971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 579/1221] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:25.621089 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:25.622419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:25.629342 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.629937 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.631030 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.631693 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.754793 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:25.757498 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=100 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:25.766494 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:25.768423 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95c6d7130d6c4ae4b8460807e6820ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c247c5f4fb74c78baaf3f4a63a04e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:25.770537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-614dec82-fc41-48a0-a054-f6e780b85237 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 200 len: 1365 microversion: 2.20 time: 0.153114 Jul 14 16:03:25.771477 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 643/1222] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:25 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:03:26.793445 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:26.797113 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:26.806666 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.807133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.809955 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.810736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.842306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d HTTP/1.1 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:26.844843 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:26.846675 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'bd039734-918c-4c52-875a-ba68f8ef112d'} Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:26.847630 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:26.849111 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:26.851150 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:26.852300 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e833452f-0b60-4366-b568-828df49f8314 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 404 len: 111 microversion: 2.20 time: 0.064747 Jul 14 16:03:26.852985 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 580/1223] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:26 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:26.863574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1584b3ba-81a9-4016-bfcd-1085d8f33efa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '.version_select at 0x7f33ffecbca0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:27.069871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1584b3ba-81a9-4016-bfcd-1085d8f33efa tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966752956" status: 204 len: 0 microversion: 2.20 time: 0.210520 Jul 14 16:03:27.070894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 644/1224] 10.222.0.47 () {60 vars in 1258 bytes} [Thu Jul 14 16:03:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966752956 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:03:30.091218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:30.092097 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:30.100861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.101320 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.102192 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.102638 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.118132 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d HTTP/1.1 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:30.119714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.121412 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'bd039734-918c-4c52-875a-ba68f8ef112d'} Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:30.122448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.123694 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.125990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:30.125990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a0b10881-0d5e-48fd-b836-0c9e1fbdc691 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 404 len: 111 microversion: 2.20 time: 0.034939 Jul 14 16:03:30.130380 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:30.130997 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: bd039734-918c-4c52-875a-ba68f8ef112d] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:30.133739 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 581/1225] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 14 16:03:30 2022] DELETE /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:30.137307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.141514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.141514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.141514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.157733 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d HTTP/1.1 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:30.159333 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'bd039734-918c-4c52-875a-ba68f8ef112d'} Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:30.161589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. Jul 14 16:03:30.164210 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:30.165653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance bd039734-918c-4c52-875a-ba68f8ef112d could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:30.165653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-d14ec94c-69b4-423b-a2ec-e03a2beaefb3 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d" status: 404 len: 111 microversion: 2.20 time: 0.034780 Jul 14 16:03:30.165653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 645/1226] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:30 2022] GET /compute/v2.1/servers/bd039734-918c-4c52-875a-ba68f8ef112d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:31.538572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:31.538572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:31.547327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.547777 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.548752 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.549560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.567761 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 HTTP/1.1 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:31.574869 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.576551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'fa2205b6-6161-416f-9364-c7110a590b66'} Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:31.577454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.579490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.581286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:31.581286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-977e2912-c1a5-4727-83cb-26dc867d0765 tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 404 len: 111 microversion: 2.20 time: 0.038964 Jul 14 16:03:31.581286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 582/1227] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 14 16:03:31 2022] DELETE /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:31.582829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:31.583532 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] [instance: fa2205b6-6161-416f-9364-c7110a590b66] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:31.590322 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.590785 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.591478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.591934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.609171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] HTTP exception thrown: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Request method failure captured: Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 HTTP/1.1 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0Dxk4gYLhILGr6ZesbjKwxWRyXHiK5qJhQd1YmlTj2xCQbJWCsd4bhIeLKtbOxXAPJ8a646QOguXRS501KFE7aV_e5japQIfjvGpZYAeQ57yZxxhPhXXCLBO_cO5ktdfW6tk7dxxCY_wh3qgpM1S0XAdtbse-tK0pZuo1ttTpD-zY7U Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:31.612717 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c247c5f4fb74c78baaf3f4a63a04e42", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c247c5f4fb74c78baaf3f4a63a04e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c247c5f4fb74c78baaf3f4a63a04e42"}]}] Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 6c247c5f4fb74c78baaf3f4a63a04e42 Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480111475 Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 95c6d7130d6c4ae4b8460807e6820ef1 Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480111475-project Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.614275 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'fa2205b6-6161-416f-9364-c7110a590b66'} Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:31.615130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. Jul 14 16:03:31.616390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:31.617909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] Returning 404 to user: Instance fa2205b6-6161-416f-9364-c7110a590b66 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:31.617909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-1a8c25a1-e369-4745-8631-d03657efc71c tempest-AttachVolumeShelveTestJSON-480111475 tempest-AttachVolumeShelveTestJSON-480111475-project] 10.222.0.47 "GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66" status: 404 len: 111 microversion: 2.20 time: 0.034347 Jul 14 16:03:31.617909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 646/1228] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 14 16:03:31 2022] GET /compute/v2.1/servers/fa2205b6-6161-416f-9364-c7110a590b66 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 16:03:32.927733 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6223c8a0-14c1-4589-a78a-e93d8f5440e2 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Action: 'create', calling method: .version_select at 0x7f33ff7f74c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-878215794", "metadata": {"Type": "work"}}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6223c8a0-14c1-4589-a78a-e93d8f5440e2 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 121 Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:32.978830 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-878215794", "metadata": {"Type": "work"}}} Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: Jul 14 16:03:32.981121 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-878215794', 'metadata': {'Type': 'work'}}}} Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise error Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:32.982751 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 16:03:32.985157 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 16:03:32.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 16:03:32.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6223c8a0-14c1-4589-a78a-e93d8f5440e2 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:32.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6223c8a0-14c1-4589-a78a-e93d8f5440e2 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.343122 Jul 14 16:03:32.986712 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 583/1229] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 14 16:03:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 16:03:32.993993 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-99df0097-9d35-4482-8e09-db1fee27f0c6 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Action: 'create', calling method: .version_select at 0x7f33ffe52ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525905755", "metadata": {"Type": "work"}}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-99df0097-9d35-4482-8e09-db1fee27f0c6 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 119 Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:32.997573 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525905755", "metadata": {"Type": "work"}}} Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 16:03:32.999092 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-525905755', 'metadata': {'Type': 'work'}}}} Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise error Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi '0' Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:32.999985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 16:03:33.001328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 16:03:33.002582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 16:03:33.002582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.002582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-99df0097-9d35-4482-8e09-db1fee27f0c6 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:33.002582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-99df0097-9d35-4482-8e09-db1fee27f0c6 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009577 Jul 14 16:03:33.002582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 647/1230] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 14 16:03:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:33.010888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7939cf48-07b1-42f3-8a2e-49a4e733dada tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Action: 'create', calling method: .version_select at 0x7f34041304c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-379886313", "metadata": {"Type": "work"}}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7939cf48-07b1-42f3-8a2e-49a4e733dada tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 118 Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:33.014940 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-379886313", "metadata": {"Type": "work"}}} Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: Jul 14 16:03:33.016457 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-379886313', 'metadata': {'Type': 'work'}}}} Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise error Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi '' Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:33.017335 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 16:03:33.018938 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 16:03:33.021520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 16:03:33.021520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.021520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7939cf48-07b1-42f3-8a2e-49a4e733dada tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:33.021520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7939cf48-07b1-42f3-8a2e-49a4e733dada tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010235 Jul 14 16:03:33.021520 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 584/1231] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 14 16:03:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:03:33.029006 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4450d530-e010-43bb-89d5-21ee8ff8d962 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Calling method '.version_select at 0x7f33ffe5b670>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.080243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-4450d530-e010-43bb-89d5-21ee8ff8d962 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] HTTP exception thrown: Volume tempest-invalid-2112243834 could not be found. Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4450d530-e010-43bb-89d5-21ee8ff8d962 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2112243834 HTTP/1.1 Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:33.082956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Volume tempest-invalid-2112243834 could not be found. Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'tempest-invalid-2112243834'} Jul 14 16:03:33.084526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2112243834 could not be found. (HTTP 404) (Request-ID: req-6421e8b3-23ea-4d32-9844-1e0fd0647aba) Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.085335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:33.086844 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2112243834 could not be found. Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:33.088122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2112243834 could not be found. Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2112243834 could not be found. Jul 14 16:03:33.091018 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.094763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4450d530-e010-43bb-89d5-21ee8ff8d962 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 404 to user: Volume tempest-invalid-2112243834 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:33.094763 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4450d530-e010-43bb-89d5-21ee8ff8d962 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2112243834" status: 404 len: 99 microversion: 2.1 time: 0.070252 Jul 14 16:03:33.106353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 648/1232] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 14 16:03:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2112243834 => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 16:03:33.106462 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3485aa25-af22-4da6-9adf-a727716172c7 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004390 Jul 14 16:03:33.106855 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 585/1233] 10.222.0.47 () {58 vars in 1139 bytes} [Thu Jul 14 16:03:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 16:03:33.117940 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3c49e2f2-1cca-4da1-9718-991120fd91a8 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003911 Jul 14 16:03:33.123481 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 649/1234] 10.222.0.47 () {58 vars in 1136 bytes} [Thu Jul 14 16:03:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 16:03:33.129314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-48e862e9-6f67-46b9-bdb0-ceb17aeef045 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Calling method '.version_select at 0x7f33ff7f7b80>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.161560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-48e862e9-6f67-46b9-bdb0-ceb17aeef045 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] HTTP exception thrown: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-48e862e9-6f67-46b9-bdb0-ceb17aeef045 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/os-volumes/b748cb2f-4901-4566-aeaa-459fbd123c84 HTTP/1.1 Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:33.170451 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'b748cb2f-4901-4566-aeaa-459fbd123c84'} Jul 14 16:03:33.172215 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. (HTTP 404) (Request-ID: req-1674804b-0342-4777-916d-c16484f2f562) Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.173100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:33.176628 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 16:03:33.178517 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-48e862e9-6f67-46b9-bdb0-ceb17aeef045 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 404 to user: Volume b748cb2f-4901-4566-aeaa-459fbd123c84 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-48e862e9-6f67-46b9-bdb0-ceb17aeef045 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/b748cb2f-4901-4566-aeaa-459fbd123c84" status: 404 len: 109 microversion: 2.1 time: 0.047398 Jul 14 16:03:33.179935 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 586/1235] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:03:33 2022] DELETE /compute/v2.1/os-volumes/b748cb2f-4901-4566-aeaa-459fbd123c84 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:33.187605 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b11b8c0d-7eac-4443-b56e-7dc7b8a65e67 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Calling method '.version_select at 0x7f3407de03a0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.219547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-b11b8c0d-7eac-4443-b56e-7dc7b8a65e67 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] HTTP exception thrown: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b11b8c0d-7eac-4443-b56e-7dc7b8a65e67 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Request method failure captured: Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/os-volumes/f58f7443-c055-450e-a8cc-36dde90f25d3 HTTP/1.1 Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D5UpxdSZuSiRMJ0kiCDumTLBRQih6X-B2JMpxyTaV7BsUA5z1qdK6TwCBTqVBf4LXv-ETe4Ba4mk07weq2ufddoZGQQ6cI-7P4TCzdxmclioWZosWu4DlmU1zjKnCxxwPiWEL6seqiyJtBAZUJa-krPApqCYGJEGpNNTV2qNu5O8pM Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:33.221516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8b4cd08a59a47a1ae0180ae4940896f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8b4cd08a59a47a1ae0180ae4940896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8b4cd08a59a47a1ae0180ae4940896f"}]}] Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: f8b4cd08a59a47a1ae0180ae4940896f Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesNegativeTest-1252600442 Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: cbca492eda35499bae86a1346374b8de Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesNegativeTest-1252600442-project Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'f58f7443-c055-450e-a8cc-36dde90f25d3'} Jul 14 16:03:33.222921 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. (HTTP 404) (Request-ID: req-690c1743-f9da-4dec-840d-a2407920570c) Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.223860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:33.225065 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:03:33.228416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b11b8c0d-7eac-4443-b56e-7dc7b8a65e67 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] Returning 404 to user: Volume f58f7443-c055-450e-a8cc-36dde90f25d3 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b11b8c0d-7eac-4443-b56e-7dc7b8a65e67 tempest-VolumesNegativeTest-1252600442 tempest-VolumesNegativeTest-1252600442-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f58f7443-c055-450e-a8cc-36dde90f25d3" status: 404 len: 109 microversion: 2.1 time: 0.041449 Jul 14 16:03:33.237650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 650/1236] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:33 2022] GET /compute/v2.1/os-volumes/f58f7443-c055-450e-a8cc-36dde90f25d3 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:38.973094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0d4f5ce2-226c-4d52-adc2-aee13490d05b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Action: 'create', calling method: .version_select at 0x7f33ff4be280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-936459868"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:39.867784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0d4f5ce2-226c-4d52-adc2-aee13490d05b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.013626 Jul 14 16:03:39.868416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 587/1237] 10.222.0.47 () {60 vars in 1154 bytes} [Thu Jul 14 16:03:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1015 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 16:03:39.881461 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8f1e0889-1dd8-4b36-b970-236d74d58f53 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3404b36310>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:39.939136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8f1e0889-1dd8-4b36-b970-236d74d58f53 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 200 len: 344 microversion: 2.1 time: 0.063009 Jul 14 16:03:39.939723 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 651/1238] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:39 2022] GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:40.960506 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-325d99d9-58c9-4f08-a50f-f5bd69e3d6e8 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340415c4c0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:41.009958 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-325d99d9-58c9-4f08-a50f-f5bd69e3d6e8 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 200 len: 345 microversion: 2.1 time: 0.054457 Jul 14 16:03:41.010540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 588/1239] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:40 2022] GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:41.022738 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-6aca8154-57cc-4d83-b659-34c2ca2bde99 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Action: 'create', calling method: .version_select at 0x7f33ffff1040>, body: {"snapshot": {"volume_id": "088dfb67-7062-4317-9d7b-4956c4e14f7b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-579265368"}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:41.589136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:41.597336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=5 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:41.646186 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-6aca8154-57cc-4d83-b659-34c2ca2bde99 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.627793 Jul 14 16:03:41.647211 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 652/1240] 10.222.0.47 () {60 vars in 1161 bytes} [Thu Jul 14 16:03:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:41.654533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:41.655508 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:41.661091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ba17cfe1-bc95-4c63-ba48-fc60d45c6c7c tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340429ab80>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:41.835201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ba17cfe1-bc95-4c63-ba48-fc60d45c6c7c tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 286 microversion: 2.1 time: 0.181533 Jul 14 16:03:41.835957 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 589/1241] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:41 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:41.847798 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-89e83b7d-c914-4b56-839d-a0d816b0abe8 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3407e04040>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:42.088900 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-89e83b7d-c914-4b56-839d-a0d816b0abe8 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.246172 Jul 14 16:03:42.089609 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 653/1242] 10.222.0.47 () {58 vars in 1139 bytes} [Thu Jul 14 16:03:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:42.101396 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7287dffb-3af2-46c8-a180-3c0c5a02b0cd tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f33ff7ec430>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:42.136189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7287dffb-3af2-46c8-a180-3c0c5a02b0cd tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 286 microversion: 2.1 time: 0.040300 Jul 14 16:03:42.137434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 590/1243] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:42 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:43.155005 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-60733197-278a-4637-9bbc-b39c7ed69d26 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3407de0f70>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:43.190011 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-60733197-278a-4637-9bbc-b39c7ed69d26 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 286 microversion: 2.1 time: 0.039248 Jul 14 16:03:43.190867 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 654/1244] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:43 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:44.204813 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6573d61d-eb0a-4d32-a23f-682abb1e95cd tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340415cdc0>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:44.238815 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6573d61d-eb0a-4d32-a23f-682abb1e95cd tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 286 microversion: 2.1 time: 0.039741 Jul 14 16:03:44.239612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 591/1245] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:44 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:45.250646 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b93b266d-4419-4af4-9187-91e8a1aeb6fc tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3407e040d0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.282365 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b93b266d-4419-4af4-9187-91e8a1aeb6fc tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 287 microversion: 2.1 time: 0.035731 Jul 14 16:03:45.283043 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 655/1246] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:45 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:45.302338 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d18b2397-8db2-47d3-9aa4-98e07d16315b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340411b310>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.470651 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d18b2397-8db2-47d3-9aa4-98e07d16315b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 202 len: 0 microversion: 2.1 time: 0.178007 Jul 14 16:03:45.471267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 592/1247] 10.222.0.47 () {58 vars in 1253 bytes} [Thu Jul 14 16:03:45 2022] DELETE /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:45.480250 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3c116b38-fb3d-42d8-9c9b-c3badafacb4a tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3407e05040>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.512547 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3c116b38-fb3d-42d8-9c9b-c3badafacb4a tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 200 len: 286 microversion: 2.1 time: 0.036176 Jul 14 16:03:45.513132 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 656/1248] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:45 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:46.525514 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6b5a4728-df54-48c5-ab01-a50cf35e84a5 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f3404130430>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.553465 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-6b5a4728-df54-48c5-ab01-a50cf35e84a5 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] HTTP exception thrown: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6b5a4728-df54-48c5-ab01-a50cf35e84a5 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Request method failure captured: Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 HTTP/1.1 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D5alOvP5xQqCCRLI8h7hWTmQMQ71mDZKl0GwLRNMwy_BhHY3pmVRcZUMFoSdU9eS0iLw8qsl2kmNAFrWx1NJH4VoP62HKQqyO9_tZ-kXwRdIXhi3aHoCYnh6bf9HKB1rbR_kokx1BJok5kCxdJhOcPWgRKPjpTQ2YtzGO6mFjzMYyI Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:46.556459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b3099836957a40e793fe9a561204e9b3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b3099836957a40e793fe9a561204e9b3"}]}] Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 73c370b8968f40618fbac9b3e010b39d Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': 'e6f08618-942d-4a29-b04c-da331527bcf6'} Jul 14 16:03:46.558857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. (HTTP 404) (Request-ID: req-1c13c457-6f94-487d-b56a-a1bd7dd30d42) Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.560009 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:46.561387 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 16:03:46.566857 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6b5a4728-df54-48c5-ab01-a50cf35e84a5 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Returning 404 to user: Snapshot e6f08618-942d-4a29-b04c-da331527bcf6 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:46.568191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6b5a4728-df54-48c5-ab01-a50cf35e84a5 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6" status: 404 len: 111 microversion: 2.1 time: 0.037374 Jul 14 16:03:46.569229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 593/1249] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 14 16:03:46 2022] GET /compute/v2.1/os-snapshots/e6f08618-942d-4a29-b04c-da331527bcf6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:46.569328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-e923a0a1-cd44-42be-9b7c-e6f97cb4a79a tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f33ffef2430>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.810027 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-e923a0a1-cd44-42be-9b7c-e6f97cb4a79a tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 202 len: 0 microversion: 2.1 time: 0.245995 Jul 14 16:03:46.810519 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 657/1250] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:03:46 2022] DELETE /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:46.819126 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c2904ca2-f48c-4636-8896-10070b3a8d91 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340420b310>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.870871 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c2904ca2-f48c-4636-8896-10070b3a8d91 tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 200 len: 344 microversion: 2.1 time: 0.055701 Jul 14 16:03:46.871444 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 594/1251] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:46 2022] GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:47.883398 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-64934aa0-055b-476a-9f6d-90bda1e5123b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f34040a0a60>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-64934aa0-055b-476a-9f6d-90bda1e5123b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] HTTP exception thrown: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-64934aa0-055b-476a-9f6d-90bda1e5123b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Request method failure captured: Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b HTTP/1.1 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D5alOvP5xQqCCRLI8h7hWTmQMQ71mDZKl0GwLRNMwy_BhHY3pmVRcZUMFoSdU9eS0iLw8qsl2kmNAFrWx1NJH4VoP62HKQqyO9_tZ-kXwRdIXhi3aHoCYnh6bf9HKB1rbR_kokx1BJok5kCxdJhOcPWgRKPjpTQ2YtzGO6mFjzMYyI Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:47.918769 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b3099836957a40e793fe9a561204e9b3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b3099836957a40e793fe9a561204e9b3"}]}] Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 73c370b8968f40618fbac9b3e010b39d Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '088dfb67-7062-4317-9d7b-4956c4e14f7b'} Jul 14 16:03:47.920450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. (HTTP 404) (Request-ID: req-6868b4f6-dac5-4c44-968d-13f0cd993891) Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.921464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:47.923063 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:03:47.924382 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-64934aa0-055b-476a-9f6d-90bda1e5123b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Returning 404 to user: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-64934aa0-055b-476a-9f6d-90bda1e5123b tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 404 len: 109 microversion: 2.1 time: 0.039487 Jul 14 16:03:47.925894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 658/1252] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:47 2022] GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:47.934420 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-08e12f65-79e2-4238-976c-d4455df1b3ea tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f340415cf70>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:47.965074 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-08e12f65-79e2-4238-976c-d4455df1b3ea tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] HTTP exception thrown: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-08e12f65-79e2-4238-976c-d4455df1b3ea tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Request method failure captured: Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b HTTP/1.1 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D5alOvP5xQqCCRLI8h7hWTmQMQ71mDZKl0GwLRNMwy_BhHY3pmVRcZUMFoSdU9eS0iLw8qsl2kmNAFrWx1NJH4VoP62HKQqyO9_tZ-kXwRdIXhi3aHoCYnh6bf9HKB1rbR_kokx1BJok5kCxdJhOcPWgRKPjpTQ2YtzGO6mFjzMYyI Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:03:47.967143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b3099836957a40e793fe9a561204e9b3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b3099836957a40e793fe9a561204e9b3"}]}] Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 73c370b8968f40618fbac9b3e010b39d Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '088dfb67-7062-4317-9d7b-4956c4e14f7b'} Jul 14 16:03:47.968892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. (HTTP 404) (Request-ID: req-bf3e2712-b947-430b-bdd8-906d5ee628df) Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.969919 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:03:47.971355 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 16:03:47.972714 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-08e12f65-79e2-4238-976c-d4455df1b3ea tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Returning 404 to user: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:47.974134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-08e12f65-79e2-4238-976c-d4455df1b3ea tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 404 len: 109 microversion: 2.1 time: 0.039544 Jul 14 16:03:47.975124 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 595/1253] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 14 16:03:47 2022] DELETE /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:47.978013 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5dac5457-9015-4f95-bc04-3e9e65518d3f tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Calling method '.version_select at 0x7f33fff2b5e0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-5dac5457-9015-4f95-bc04-3e9e65518d3f tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] HTTP exception thrown: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5dac5457-9015-4f95-bc04-3e9e65518d3f tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Request method failure captured: Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b HTTP/1.1 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D5alOvP5xQqCCRLI8h7hWTmQMQ71mDZKl0GwLRNMwy_BhHY3pmVRcZUMFoSdU9eS0iLw8qsl2kmNAFrWx1NJH4VoP62HKQqyO9_tZ-kXwRdIXhi3aHoCYnh6bf9HKB1rbR_kokx1BJok5kCxdJhOcPWgRKPjpTQ2YtzGO6mFjzMYyI Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:03:48.016352 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b3099836957a40e793fe9a561204e9b3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b3099836957a40e793fe9a561204e9b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b3099836957a40e793fe9a561204e9b3"}]}] Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: b3099836957a40e793fe9a561204e9b3 Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1885568388 Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 73c370b8968f40618fbac9b3e010b39d Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1885568388-project Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '088dfb67-7062-4317-9d7b-4956c4e14f7b'} Jul 14 16:03:48.017943 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. (HTTP 404) (Request-ID: req-854d2717-5dd0-4c41-9219-7886e3d167c2) Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:48.018817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:03:48.020069 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:03:48.021229 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-5dac5457-9015-4f95-bc04-3e9e65518d3f tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] Returning 404 to user: Volume 088dfb67-7062-4317-9d7b-4956c4e14f7b could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-5dac5457-9015-4f95-bc04-3e9e65518d3f tempest-VolumesSnapshotsTestJSON-1885568388 tempest-VolumesSnapshotsTestJSON-1885568388-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b" status: 404 len: 109 microversion: 2.1 time: 0.034877 Jul 14 16:03:48.022575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 659/1254] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 14 16:03:47 2022] GET /compute/v2.1/os-volumes/088dfb67-7062-4317-9d7b-4956c4e14f7b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:54.436399 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409889773"}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:54.437065 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:54.443667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.444120 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.444886 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.445323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.584608 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.network.security_group_api [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Removing security group 751b4e4d-cae7-4e22-8416-a520c22e8827 from port 7712455a-3773-4ae7-ad3e-5616bc3be1d7 Jul 14 16:03:55.100531 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a1f8aacd-8836-408c-acbb-7780f217f191 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action" status: 202 len: 0 microversion: 2.1 time: 0.668345 Jul 14 16:03:55.115108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-f3359617-29b9-4763-a3db-cf02f5643825 req-9f3d64b8-e62b-4fa0-9b70-2db8ce1ccd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:55.116545 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 596/1255] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:03:54 2022] POST /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:55.143298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-f3359617-29b9-4763-a3db-cf02f5643825 req-9f3d64b8-e62b-4fa0-9b70-2db8ce1ccd97 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.143298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-f3359617-29b9-4763-a3db-cf02f5643825 req-9f3d64b8-e62b-4fa0-9b70-2db8ce1ccd97 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.173012 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-f3359617-29b9-4763-a3db-cf02f5643825 req-9f3d64b8-e62b-4fa0-9b70-2db8ce1ccd97 service nova] Creating event network-changed:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:03:55.179464 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-f3359617-29b9-4763-a3db-cf02f5643825 req-9f3d64b8-e62b-4fa0-9b70-2db8ce1ccd97 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074801 Jul 14 16:03:55.181165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 660/1256] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:57.183959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.185336 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-a89e119b-cc32-407c-b34b-3d3b0a50624b req-b2d31ac7-77c4-4481-ae0a-5875681b148b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:57.188988 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.205050 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a89e119b-cc32-407c-b34b-3d3b0a50624b req-b2d31ac7-77c4-4481-ae0a-5875681b148b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.205516 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.206259 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.207694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a89e119b-cc32-407c-b34b-3d3b0a50624b req-b2d31ac7-77c4-4481-ae0a-5875681b148b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.208840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.213253 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.239578 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-a89e119b-cc32-407c-b34b-3d3b0a50624b req-b2d31ac7-77c4-4481-ae0a-5875681b148b service nova] Creating event network-changed:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:03:57.246253 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-a89e119b-cc32-407c-b34b-3d3b0a50624b req-b2d31ac7-77c4-4481-ae0a-5875681b148b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068032 Jul 14 16:03:57.250795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 661/1257] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:57.375954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lazy-loading 'services' on Instance uuid a58f5553-eafd-48fa-9642-1dbeab508a75 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:03:57.673331 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-477a4b92-8466-4671-b2c9-eb2874498653 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments/4e2e25cf-9dff-435c-a785-d69f28dd6ef9" status: 202 len: 0 microversion: 2.1 time: 0.500312 Jul 14 16:03:57.678053 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 597/1258] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:03:57 2022] DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments/4e2e25cf-9dff-435c-a785-d69f28dd6ef9 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:57.685512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.686455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.703694 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.704321 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.708358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.709002 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.751895 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-bbe3083e-ccd2-4463-a768-4763fede8c09 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071701 Jul 14 16:03:57.752619 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 662/1259] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:57 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:58.770181 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.772635 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:58.781991 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.782728 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.784217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.785156 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.833284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-315d2783-0999-4b2c-9428-c4fd322b2354 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072178 Jul 14 16:03:58.834389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 598/1260] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:58 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:59.846221 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:59.847148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:59.853746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.854228 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.855044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.855482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.894116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-26b37510-f924-41cc-b321-ab20595a89d6 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042316 Jul 14 16:03:59.894116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 663/1261] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:59 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:03:59.902071 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:59.903833 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:59.912784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.913738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.914174 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.914655 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.013443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] HTTP exception thrown: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 is not attached to volume 4e2e25cf-9dff-435c-a785-d69f28dd6ef9 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Request method failure captured: Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments/4e2e25cf-9dff-435c-a785-d69f28dd6ef9 HTTP/1.1 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D24jkukOU5EwukLToqwnYBPjggCaxm4AzPIyu-C1m2WxYFWWVX8g_YG1M75rvIH6jsIovKsjQzTy1-VcY2jOsF43N50uyHU1n-bKSixwhB2w_pCvi_3a2MK7f-qXEYRynX6-oeJ_JIBZjBCI9s5NN-N7vm_H195hz7oHA8YGH3XkE4 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 923fdefb5a7246038c012ee78bf00dc2 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:04:00.018784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/923fdefb5a7246038c012ee78bf00dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_923fdefb5a7246038c012ee78bf00dc2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/923fdefb5a7246038c012ee78bf00dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/923fdefb5a7246038c012ee78bf00dc2"}]}] Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 923fdefb5a7246038c012ee78bf00dc2 Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-TestMinimumBasicScenario-1069920730-project Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 2c1f1c69e35847b9a6323d8dd3863bf7 Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-TestMinimumBasicScenario-1069920730-project Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:04:00.021881 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 is not attached to volume 4e2e25cf-9dff-435c-a785-d69f28dd6ef9 Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'server_id': 'a58f5553-eafd-48fa-9642-1dbeab508a75', 'id': '4e2e25cf-9dff-435c-a785-d69f28dd6ef9'} Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4e2e25cf-9dff-435c-a785-d69f28dd6ef9. Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:00.022734 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 is not attached to volume 4e2e25cf-9dff-435c-a785-d69f28dd6ef9 Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 is not attached to volume 4e2e25cf-9dff-435c-a785-d69f28dd6ef9 Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:04:00.023968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Returning 404 to user: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 is not attached to volume 4e2e25cf-9dff-435c-a785-d69f28dd6ef9 {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:00.025917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-296a50d7-1176-4198-9053-f80edcc8d204 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments/4e2e25cf-9dff-435c-a785-d69f28dd6ef9" status: 404 len: 154 microversion: 2.1 time: 0.129111 Jul 14 16:04:00.027326 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 599/1262] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 14 16:03:59 2022] DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75/os-volume_attachments/4e2e25cf-9dff-435c-a785-d69f28dd6ef9 => generated 154 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:01.542842 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:01.544125 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:01.551552 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.552003 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.552796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.556226 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.579753 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:02.384712 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-a60948dc-2d12-4a16-b665-8a2d53cf54a8 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 204 len: 0 microversion: 2.1 time: 0.845621 Jul 14 16:04:02.386255 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 664/1263] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:04:01 2022] DELETE /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:02.407500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:02.407500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:02.409414 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.409934 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.410705 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.411142 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.557316 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:02.572726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7c065dd7-d10c-4d4c-a9b8-dbd297aabbd3 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1554 microversion: 2.1 time: 0.181674 Jul 14 16:04:02.574611 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 600/1264] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:02 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:03.600366 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:03.601738 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:03.608731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.609206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.610239 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.610760 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.779201 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:03.787756 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f063d676-bd2a-4f30-98e2-692f30aff32f tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1554 microversion: 2.1 time: 0.191568 Jul 14 16:04:03.797747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 665/1265] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:03 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:04.805746 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:04.808626 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:04.820782 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.821240 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:04.822133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.822576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.169086 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:05.177633 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0fd6656a-20d0-4572-bff9-d4619ed1edfc tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1554 microversion: 2.1 time: 0.376780 Jul 14 16:04:05.188036 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 601/1266] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:04 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1554 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:05.585903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-51c82528-d0a6-447e-91b0-46944478f30b req-531d9c88-2490-4a33-bdf2-4fcc0128416d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58f5553-eafd-48fa-9642-1dbeab508a75", "name": "network-vif-deleted", "tag": "7712455a-3773-4ae7-ad3e-5616bc3be1d7"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:05.594604 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-51c82528-d0a6-447e-91b0-46944478f30b req-531d9c88-2490-4a33-bdf2-4fcc0128416d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.595049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-51c82528-d0a6-447e-91b0-46944478f30b req-531d9c88-2490-4a33-bdf2-4fcc0128416d service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.608108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-51c82528-d0a6-447e-91b0-46944478f30b req-531d9c88-2490-4a33-bdf2-4fcc0128416d service nova] Creating event network-vif-deleted:7712455a-3773-4ae7-ad3e-5616bc3be1d7 for instance a58f5553-eafd-48fa-9642-1dbeab508a75 on hv-cinder-83716 Jul 14 16:04:05.613262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-51c82528-d0a6-447e-91b0-46944478f30b req-531d9c88-2490-4a33-bdf2-4fcc0128416d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031031 Jul 14 16:04:05.613987 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 666/1267] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:06.195800 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:06.196428 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:06.214226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.214226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.214226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.214226 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.241999 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.242401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.242916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lazy-loading 'fault' on Instance uuid a58f5553-eafd-48fa-9642-1dbeab508a75 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:04:06.287623 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1f1c69e35847b9a6323d8dd3863bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923fdefb5a7246038c012ee78bf00dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:06.296255 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-13548ec2-82f9-4ec3-a166-cb82b9bfb027 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 200 len: 1348 microversion: 2.1 time: 0.104517 Jul 14 16:04:06.303376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 602/1268] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:06 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:07.323076 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.323789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] [instance: a58f5553-eafd-48fa-9642-1dbeab508a75] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.332067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.332555 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.333346 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.333791 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.348555 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] HTTP exception thrown: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Request method failure captured: Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 HTTP/1.1 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D24jkukOU5EwukLToqwnYBPjggCaxm4AzPIyu-C1m2WxYFWWVX8g_YG1M75rvIH6jsIovKsjQzTy1-VcY2jOsF43N50uyHU1n-bKSixwhB2w_pCvi_3a2MK7f-qXEYRynX6-oeJ_JIBZjBCI9s5NN-N7vm_H195hz7oHA8YGH3XkE4 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 923fdefb5a7246038c012ee78bf00dc2 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:04:07.350453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/923fdefb5a7246038c012ee78bf00dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_923fdefb5a7246038c012ee78bf00dc2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/923fdefb5a7246038c012ee78bf00dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/923fdefb5a7246038c012ee78bf00dc2"}]}] Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 923fdefb5a7246038c012ee78bf00dc2 Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1069920730 Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-TestMinimumBasicScenario-1069920730-project Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: 2c1f1c69e35847b9a6323d8dd3863bf7 Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-TestMinimumBasicScenario-1069920730-project Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. Jul 14 16:04:07.352176 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'a58f5553-eafd-48fa-9642-1dbeab508a75'} Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:07.353108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. Jul 14 16:04:07.354875 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:04:07.356428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Returning 404 to user: Instance a58f5553-eafd-48fa-9642-1dbeab508a75 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:07.356428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c3a1ad1a-44ce-426b-b97a-76ac25c5aefd tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75" status: 404 len: 111 microversion: 2.1 time: 0.034791 Jul 14 16:04:07.356428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 667/1269] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:07 2022] GET /compute/v2.1/servers/a58f5553-eafd-48fa-9642-1dbeab508a75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:07.362928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9ac65002-0306-4c51-8220-2bd3ae5b5190 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] Calling method '.version_select at 0x7f33ff70a550>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.572783 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9ac65002-0306-4c51-8220-2bd3ae5b5190 tempest-TestMinimumBasicScenario-1069920730 tempest-TestMinimumBasicScenario-1069920730-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-294235641" status: 202 len: 0 microversion: 2.1 time: 0.215312 Jul 14 16:04:07.586409 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 603/1270] 10.222.0.47 () {58 vars in 1268 bytes} [Thu Jul 14 16:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-294235641 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:05:08.038817 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:08.040044 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:08.047263 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-753651299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2067800923", "security_groups": [{"name": "tempest-secgroup-smoke-916256028"}], "block_device_mapping_v2": [{"uuid": "052d8bff-f245-416a-9380-ed2fd136e8c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6678e1c-1ac9-413e-832a-e75939816f1b"}]}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:08.388196 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.network.neutron [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] validate_networks() for [('c6678e1c-1ac9-413e-832a-e75939816f1b', None, None, None, None, None)] {{(pid=129992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:08.830483 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:08.830971 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image limits 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:08.831451 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Flavor pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:08.831863 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Image pref 0:0:0 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:08.832287 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.virt.hardware [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:08.842009 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.842466 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.843303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.843768 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.861127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:08.865343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Getting quotas for user ba765c1a8c6c449ca699eb7a44dde50b and project 93233d8a364e44edad9877e1eaa82b4d. Resources: {'cores', 'ram', 'instances'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:08.929157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Going to run 1 instances... {{(pid=129992) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:08.931427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='052d8bff-f245-416a-9380-ed2fd136e8c0',volume_size=None,volume_type=None)] {{(pid=129992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:09.501995 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-c893bcb3-6864-487c-807b-8458e480eea9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.465198 Jul 14 16:05:09.506032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 668/1271] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:05:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:05:09.511576 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:09.512345 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:09.516341 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-887fda15-5c9d-4be0-9256-f2626578df8a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:09.516961 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-887fda15-5c9d-4be0-9256-f2626578df8a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:09.741721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-887fda15-5c9d-4be0-9256-f2626578df8a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.748561 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-887fda15-5c9d-4be0-9256-f2626578df8a tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1094 microversion: 2.1 time: 0.238998 Jul 14 16:05:09.750045 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 604/1272] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:09 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1094 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:10.768156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2e427c4f-08d9-4e5d-8071-3222356f72d0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:10.768774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2e427c4f-08d9-4e5d-8071-3222356f72d0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:10.831572 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2e427c4f-08d9-4e5d-8071-3222356f72d0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:10.838584 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2e427c4f-08d9-4e5d-8071-3222356f72d0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1094 microversion: 2.1 time: 0.075548 Jul 14 16:05:10.839164 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 669/1273] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:10 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:11.856305 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2334ed76-feca-400a-964a-d3c2710dcc00 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:11.856912 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2334ed76-feca-400a-964a-d3c2710dcc00 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:11.912780 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2334ed76-feca-400a-964a-d3c2710dcc00 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.919701 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2334ed76-feca-400a-964a-d3c2710dcc00 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1094 microversion: 2.1 time: 0.067790 Jul 14 16:05:11.920327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 605/1274] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:11 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:12.937795 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:12.938703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:12.945131 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.945588 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.946478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.946919 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.010240 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.022526 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-705af5c2-f0c6-4ea5-b7bc-6ee90419afe9 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1144 microversion: 2.1 time: 0.088843 Jul 14 16:05:13.023582 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 670/1275] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:12 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:14.043332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:14.044327 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:14.053007 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.053540 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.054441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.054952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.120197 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:14.128400 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-3d705a77-8bdd-4860-95f7-45e10b090848 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1136 microversion: 2.1 time: 0.089090 Jul 14 16:05:14.128980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 606/1276] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:14 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:15.150827 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:15.151922 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:15.159484 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.159988 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.160807 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.161238 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.248564 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.267945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3c8db9af-f4ad-4b17-8fd8-0c55e233c376 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1200 microversion: 2.1 time: 0.120848 Jul 14 16:05:15.268554 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 671/1277] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:15 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1200 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:16.286544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:16.288722 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:16.297771 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.298713 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.299775 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.300973 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.487416 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.494917 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9bcd9325-e764-46dc-b64f-133036eaa330 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1277 microversion: 2.1 time: 0.212879 Jul 14 16:05:16.495479 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 607/1278] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:16 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:16.938440 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-5c864d17-34ef-40f1-b0d3-8e77d0202dca req-44e3e1d6-7e86-46b0-9f88-aace5e44b31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc28cb2d-1e46-4ede-95e8-a7ed7d886159", "tag": "0a0a3882-0d33-4335-8acd-cc29c3e22a89"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:16.953083 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-5c864d17-34ef-40f1-b0d3-8e77d0202dca req-44e3e1d6-7e86-46b0-9f88-aace5e44b31f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.953401 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-5c864d17-34ef-40f1-b0d3-8e77d0202dca req-44e3e1d6-7e86-46b0-9f88-aace5e44b31f service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.968499 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-5c864d17-34ef-40f1-b0d3-8e77d0202dca req-44e3e1d6-7e86-46b0-9f88-aace5e44b31f service nova] Creating event network-changed:0a0a3882-0d33-4335-8acd-cc29c3e22a89 for instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 on hv-cinder-83716 Jul 14 16:05:16.971181 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-5c864d17-34ef-40f1-b0d3-8e77d0202dca req-44e3e1d6-7e86-46b0-9f88-aace5e44b31f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037330 Jul 14 16:05:16.971803 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 672/1279] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:05:17.514533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:17.515871 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:17.524443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.524982 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.526401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.533069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.752454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.760256 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-73010647-cc51-4582-ab06-fc0d0f214435 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.249791 Jul 14 16:05:17.760996 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 608/1280] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:17 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:18.781606 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:18.782338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:18.789137 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.789507 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.790305 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.790747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.807740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:18.808308 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:18.851677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:18.950800 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:18.958789 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9bb60ddb-e917-4e18-8b2a-284b0bdb0977 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.182027 Jul 14 16:05:18.959381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 673/1281] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:18 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:19.976738 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:19.977980 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:19.984962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.985419 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.986410 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.986853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.138184 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:20.151459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8f9a9d1d-3d7e-4b64-a1c7-5858195488ef tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.178798 Jul 14 16:05:20.152077 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 609/1282] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:19 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:21.174702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:21.174702 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:21.176406 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=8 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:21.181632 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.182193 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.183037 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.183536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.334560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.343258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-76caf2d4-73de-48af-9590-bbbd708d6f6b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.174585 Jul 14 16:05:21.351409 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 674/1283] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:21 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:22.368004 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:22.368838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:22.371390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=4 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:22.378108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.378560 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.379362 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.379794 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.605068 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.614735 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0a6d5f59-a9d6-47b9-9075-80e6807d3d86 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.250856 Jul 14 16:05:22.615325 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 610/1284] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:22 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:23.638372 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:23.639314 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:23.647869 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.648345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.649361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.650091 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.809955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.818911 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b8ebb744-be48-4b51-bd13-f9d5998b9e4d tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.184461 Jul 14 16:05:23.829289 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 675/1285] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:23 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:24.837449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:24.838108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:24.850022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.850483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.851283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.851727 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.008581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.016533 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-772bf4f8-6ea7-4652-9afb-69ca9d26bc06 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.183736 Jul 14 16:05:25.021122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 611/1286] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:24 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:26.048690 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:26.049162 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:26.062706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.068448 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.069624 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.070356 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.262122 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.273283 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-26c3abb2-bc6e-49eb-bfda-fed7ba75f19f tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.241926 Jul 14 16:05:26.274454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 676/1287] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:26 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:27.292818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.293431 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.301565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.302049 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.302995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.303430 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.540098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:27.549594 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-7aa5e3e0-6c76-4a6b-922a-17bfaa7b6fd2 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.260713 Jul 14 16:05:27.550464 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 612/1288] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:28.083845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-37e1019d-4da3-44ff-b66f-ea76387fd906 req-0f0b001c-f3ad-4a8b-9428-04c15fe7a347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc28cb2d-1e46-4ede-95e8-a7ed7d886159", "name": "network-vif-plugged", "status": "completed", "tag": "0a0a3882-0d33-4335-8acd-cc29c3e22a89"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:28.098719 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-37e1019d-4da3-44ff-b66f-ea76387fd906 req-0f0b001c-f3ad-4a8b-9428-04c15fe7a347 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.099267 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-37e1019d-4da3-44ff-b66f-ea76387fd906 req-0f0b001c-f3ad-4a8b-9428-04c15fe7a347 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.115112 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-37e1019d-4da3-44ff-b66f-ea76387fd906 req-0f0b001c-f3ad-4a8b-9428-04c15fe7a347 service nova] Creating event network-vif-plugged:0a0a3882-0d33-4335-8acd-cc29c3e22a89 for instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 on hv-cinder-83716 Jul 14 16:05:28.120536 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-37e1019d-4da3-44ff-b66f-ea76387fd906 req-0f0b001c-f3ad-4a8b-9428-04c15fe7a347 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040332 Jul 14 16:05:28.121379 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 677/1289] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:28.566968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:28.568168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:28.575392 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.576069 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.577863 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:28.578473 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:28.777115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:28.787993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ac207a08-77af-4f5d-ada2-1b9306c3f03b tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.224755 Jul 14 16:05:28.789147 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 613/1290] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:28 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:29.806337 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:29.807136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:29.814711 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.815165 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.815934 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.816370 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.952094 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:29.960096 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9f0fafee-a857-484e-b5c0-0647915f4cd3 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1265 microversion: 2.1 time: 0.158398 Jul 14 16:05:29.960677 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 678/1291] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:29 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:30.984844 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:30.985456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:30.994246 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.994786 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.995459 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.996105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.180729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.190717 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-57e74a5b-070d-4f85-8b64-a9ecfdba8877 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1451 microversion: 2.1 time: 0.209892 Jul 14 16:05:31.191292 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 614/1292] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:30 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:31.209259 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.209904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.216701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.217116 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.218428 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.219060 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.437560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.499432 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-05540e10-d4ab-4873-993b-b5d780109626 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1451 microversion: 2.1 time: 0.294134 Jul 14 16:05:31.500128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 679/1293] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:31 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1451 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:34.787471 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-2dde0a1f-ce31-4b45-94ac-00374ae00f5e req-70b9a12a-4ceb-4f41-a357-397effbe8c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc28cb2d-1e46-4ede-95e8-a7ed7d886159", "tag": "0a0a3882-0d33-4335-8acd-cc29c3e22a89"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:34.798599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-2dde0a1f-ce31-4b45-94ac-00374ae00f5e req-70b9a12a-4ceb-4f41-a357-397effbe8c98 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.798599 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-2dde0a1f-ce31-4b45-94ac-00374ae00f5e req-70b9a12a-4ceb-4f41-a357-397effbe8c98 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.811656 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-2dde0a1f-ce31-4b45-94ac-00374ae00f5e req-70b9a12a-4ceb-4f41-a357-397effbe8c98 service nova] Creating event network-changed:0a0a3882-0d33-4335-8acd-cc29c3e22a89 for instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 on hv-cinder-83716 Jul 14 16:05:34.817136 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-2dde0a1f-ce31-4b45-94ac-00374ae00f5e req-70b9a12a-4ceb-4f41-a357-397effbe8c98 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033453 Jul 14 16:05:34.822096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 615/1294] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:36.517745 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f28ed5eb-de93-464a-8537-e4e871af83fa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Action: 'create', calling method: .version_select at 0x7f3407e0e9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1368178498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtXznQIBzeASXyA2AzgpTUsdUY8p8VHJf90/GN9t92IlP4y9JQj46e+YtrSxp+ywT2NucsuePBCiDUp9D1Cm8JDGjB7adQyIlwrjg2n1Gh/RU57+dCmCzvvsla3VTEivQ=="}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:36.532978 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-f28ed5eb-de93-464a-8537-e4e871af83fa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Getting quotas for project 955b9d20401546f9a3f8477a9e67fc24. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:36.537307 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.quota [None req-f28ed5eb-de93-464a-8537-e4e871af83fa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Getting quotas for user 0d16fe0fde164dd8b0652168fc438263 and project 955b9d20401546f9a3f8477a9e67fc24. Resources: {'key_pairs'} {{(pid=129992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:36.660963 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f28ed5eb-de93-464a-8537-e4e871af83fa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.322518 Jul 14 16:05:36.666563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 680/1295] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 14 16:05:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:56.000014 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-624971504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1368178498", "security_groups": [{"name": "tempest-secgroup-smoke-1333714580"}], "networks": [{"uuid": "5157885e-3d6b-4c1b-bf17-bd14f122ecf8"}], "block_device_mapping_v2": [{"uuid": "809bba2c-b95a-4b03-8f46-547907c7b21e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:56.008726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=28 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:56.009379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=56 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:56.117098 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.network.neutron [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] validate_networks() for [('5157885e-3d6b-4c1b-bf17-bd14f122ecf8', None, None, None, None, None)] {{(pid=129991) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:05:56.539544 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Flavor limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:56.539993 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Image limits 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:56.540469 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Flavor pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:56.540880 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Image pref 0:0:0 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:56.541295 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.virt.hardware [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:56.550591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.551041 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.551839 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.552276 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.570108 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Getting quotas for project 955b9d20401546f9a3f8477a9e67fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:05:56.574169 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.quota [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Getting quotas for user 0d16fe0fde164dd8b0652168fc438263 and project 955b9d20401546f9a3f8477a9e67fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=129991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:05:56.632191 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Going to run 1 instances... {{(pid=129991) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:05:56.637381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='809bba2c-b95a-4b03-8f46-547907c7b21e',volume_size=None,volume_type=None)] {{(pid=129991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:05:57.237434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8470c7b0-3fc8-493e-b676-6fc9b30c2d67 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.242342 Jul 14 16:05:57.238407 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 616/1296] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 14 16:05:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:05:57.245516 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=54 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:57.254180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=4 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:57.254180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:57.254180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ef20b0c2-1f9c-46bf-9e90-087dcdfcb029 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:57.254180 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ef20b0c2-1f9c-46bf-9e90-087dcdfcb029 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:57.305896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ef20b0c2-1f9c-46bf-9e90-087dcdfcb029 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.313661 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ef20b0c2-1f9c-46bf-9e90-087dcdfcb029 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1088 microversion: 2.1 time: 0.069474 Jul 14 16:05:57.314261 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 681/1297] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:57 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:58.332042 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-19ddaaae-b183-409e-9697-b57d937baa85 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:58.332595 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-19ddaaae-b183-409e-9697-b57d937baa85 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:58.391640 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-19ddaaae-b183-409e-9697-b57d937baa85 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.398954 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-19ddaaae-b183-409e-9697-b57d937baa85 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1088 microversion: 2.1 time: 0.071418 Jul 14 16:05:58.399521 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 617/1298] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:58 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:59.415871 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:59.416424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:59.424876 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.425325 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.426115 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.426548 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.491316 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.499520 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cbdd334b-b39b-4cee-876f-4d66c83210db tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1186 microversion: 2.1 time: 0.087717 Jul 14 16:05:59.500105 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 682/1299] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:59 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:00.517609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:00.518314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:00.525609 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.526103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.526883 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.527323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.787218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.795853 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-58bf359d-801f-4fe8-9387-08225a034bf0 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1272 microversion: 2.1 time: 0.283221 Jul 14 16:06:00.796612 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 618/1300] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:00 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:01.400387 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-ee0a5b6a-502f-40fb-8cdd-018ad813e5b7 req-5f82d899-58d7-4ca1-80fd-7f039d2b7bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:01.413276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-ee0a5b6a-502f-40fb-8cdd-018ad813e5b7 req-5f82d899-58d7-4ca1-80fd-7f039d2b7bf3 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.414174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-ee0a5b6a-502f-40fb-8cdd-018ad813e5b7 req-5f82d899-58d7-4ca1-80fd-7f039d2b7bf3 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.431035 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-ee0a5b6a-502f-40fb-8cdd-018ad813e5b7 req-5f82d899-58d7-4ca1-80fd-7f039d2b7bf3 service nova] Creating event network-changed:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:06:01.436829 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-ee0a5b6a-502f-40fb-8cdd-018ad813e5b7 req-5f82d899-58d7-4ca1-80fd-7f039d2b7bf3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110587 Jul 14 16:06:01.437543 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 683/1301] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:01.813096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:01.813731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:01.820361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.820814 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.821575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.827267 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.961845 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:01.969483 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-e54224c9-9f62-4eb1-88d7-1335c12153ff tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.160861 Jul 14 16:06:01.970091 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 619/1302] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:01 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:02.987561 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:02.988272 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:02.994583 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:02.995036 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:02.995797 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:02.996233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.127902 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.135351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-830aec9f-1f76-4eb8-becd-6835310a5fa3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.152479 Jul 14 16:06:03.135918 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 684/1303] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:02 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:04.152417 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:04.153037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:04.159629 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.160078 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.160846 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.161293 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.290063 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.297806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-2a2fd8de-dae6-4617-855d-9fe54a9842a6 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.149187 Jul 14 16:06:04.298342 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 620/1304] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:04 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:05.314657 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:05.315262 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.321832 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.322298 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.323093 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.323534 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.459946 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.467650 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-69ccaa1c-67df-4c68-ba6d-1f3d0076f98f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.156883 Jul 14 16:06:05.468233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 685/1305] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:05 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:06.485249 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:06.485971 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:06.492755 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.493151 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.493992 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.494433 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.558892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=2 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:06.906385 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.913997 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-dc2fecd9-7743-4fa7-ab95-b2c6baaf0190 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.433457 Jul 14 16:06:06.914652 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 621/1306] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:06 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:07.932994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:07.933621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:07.939912 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.940367 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.941130 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.941569 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.076391 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:08.084310 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ed4fcc5b-3114-405a-84a4-815548da9789 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.155202 Jul 14 16:06:08.084901 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 686/1307] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:07 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:09.102089 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:09.102678 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:09.105168 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell0:SELECT=8 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:09.111025 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.111490 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:09.112323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.112769 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:09.273424 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:09.281225 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a1f5bf09-d566-4646-b4bd-54b56c785758 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.183185 Jul 14 16:06:09.281764 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 622/1308] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:09 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:10.299529 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:10.300171 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:10.303142 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell0:SELECT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:10.308597 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:10.311705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:10.311705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:10.311705 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:10.475955 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:10.485658 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9d614717-7a0e-4354-b4fc-79ebc5a7710c tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.190041 Jul 14 16:06:10.486326 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 687/1309] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:10 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:11.503501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:11.504103 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:11.510610 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.511060 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:11.511825 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.512269 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:11.647802 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:11.655436 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-8d6f5a22-6c2a-4231-995c-f2f73cd22e37 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.155860 Jul 14 16:06:11.656008 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 623/1310] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:11 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:12.245334 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-f8885b27-d4a6-4173-b210-7d6418e05d81 req-73181e94-f430-4ac1-b732-3eb176567832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "name": "network-vif-plugged", "status": "completed", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:12.254389 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-f8885b27-d4a6-4173-b210-7d6418e05d81 req-73181e94-f430-4ac1-b732-3eb176567832 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:12.254841 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-f8885b27-d4a6-4173-b210-7d6418e05d81 req-73181e94-f430-4ac1-b732-3eb176567832 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.266081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-f8885b27-d4a6-4173-b210-7d6418e05d81 req-73181e94-f430-4ac1-b732-3eb176567832 service nova] Creating event network-vif-plugged:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:06:12.271425 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-f8885b27-d4a6-4173-b210-7d6418e05d81 req-73181e94-f430-4ac1-b732-3eb176567832 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Jul 14 16:06:12.272434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 688/1311] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:12.673793 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:12.674497 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:12.681139 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:12.681591 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.682390 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:12.682829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.819163 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:12.827562 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d604fc77-c793-48c7-a534-e2d4a0daed10 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.158885 Jul 14 16:06:12.828210 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 624/1312] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:12 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:13.846421 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:13.847168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:13.853692 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.854351 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:13.855129 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.855576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:13.994859 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:14.002597 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b0c38480-6235-4e13-9859-3a7fb69a4f38 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1260 microversion: 2.1 time: 0.160383 Jul 14 16:06:14.003185 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 689/1313] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:13 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:15.019122 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:15.019723 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:15.026434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.026888 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.027665 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.028100 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.166029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:15.174374 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f39f87cf-262a-402b-9309-3111f50771ad tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1445 microversion: 2.1 time: 0.159181 Jul 14 16:06:15.174952 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 625/1314] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:15 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:15.191345 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:15.191962 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:15.198489 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.198941 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.199699 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.200161 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.331157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:15.338945 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-45853269-2df6-4c40-bada-8e661283223d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1445 microversion: 2.1 time: 0.151476 Jul 14 16:06:15.339525 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 690/1315] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:15 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:17.432306 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-f395784c-5761-4a57-b880-a888858ed188 req-63d12c9e-bf5b-428d-9659-083affb4886a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:17.441743 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-f395784c-5761-4a57-b880-a888858ed188 req-63d12c9e-bf5b-428d-9659-083affb4886a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.442230 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-f395784c-5761-4a57-b880-a888858ed188 req-63d12c9e-bf5b-428d-9659-083affb4886a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.454116 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-f395784c-5761-4a57-b880-a888858ed188 req-63d12c9e-bf5b-428d-9659-083affb4886a service nova] Creating event network-changed:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:06:17.459720 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-f395784c-5761-4a57-b880-a888858ed188 req-63d12c9e-bf5b-428d-9659-083affb4886a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031033 Jul 14 16:06:17.460343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 626/1316] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:04.293139 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.293978 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.296279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=22 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.296881 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=46 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.300726 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.308788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=52 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.308788 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-8e4b2d35-f6bb-4a8f-ab26-c3de46330961 req-a2613303-37ef-43f3-93a4-02e8f7086c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc28cb2d-1e46-4ede-95e8-a7ed7d886159", "tag": "0a0a3882-0d33-4335-8acd-cc29c3e22a89"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:04.314537 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8e4b2d35-f6bb-4a8f-ab26-c3de46330961 req-a2613303-37ef-43f3-93a4-02e8f7086c58 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.314990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8e4b2d35-f6bb-4a8f-ab26-c3de46330961 req-a2613303-37ef-43f3-93a4-02e8f7086c58 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.315453 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.316557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.317437 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.320052 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.327572 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-8e4b2d35-f6bb-4a8f-ab26-c3de46330961 req-a2613303-37ef-43f3-93a4-02e8f7086c58 service nova] Creating event network-changed:0a0a3882-0d33-4335-8acd-cc29c3e22a89 for instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 on hv-cinder-83716 Jul 14 16:07:04.332838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-8e4b2d35-f6bb-4a8f-ab26-c3de46330961 req-a2613303-37ef-43f3-93a4-02e8f7086c58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Jul 14 16:07:04.333700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 627/1317] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:04.349669 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Going to try to terminate instance {{(pid=129992) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:07:04.662706 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce8389b7-f3f7-4e64-b9ea-5afd65218990 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 204 len: 0 microversion: 2.1 time: 0.373499 Jul 14 16:07:04.666007 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 691/1318] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:07:04 2022] DELETE /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:07:04.673539 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.674287 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.683384 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.686211 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.687892 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.688379 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.841617 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.849285 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f08ccc1a-d7c8-4fb7-82b5-52f1c96eb002 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1576 microversion: 2.1 time: 0.180190 Jul 14 16:07:04.849882 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 628/1319] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:04 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:05.868891 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:05.869589 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:05.876321 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:05.876772 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:05.877521 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:05.877979 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.020478 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:06.028198 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-4d5b0bc0-fd1e-406c-9e7c-bedcb377303e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1576 microversion: 2.1 time: 0.163643 Jul 14 16:07:06.028775 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 692/1320] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:05 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:06.873106 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-8cbe4263-a5b6-4a89-8846-653e30108bcf req-071b25a3-100e-4917-a47d-9ffc1538c399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc28cb2d-1e46-4ede-95e8-a7ed7d886159", "name": "network-vif-deleted", "tag": "0a0a3882-0d33-4335-8acd-cc29c3e22a89"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:06.883875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8cbe4263-a5b6-4a89-8846-653e30108bcf req-071b25a3-100e-4917-a47d-9ffc1538c399 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.883875 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-8cbe4263-a5b6-4a89-8846-653e30108bcf req-071b25a3-100e-4917-a47d-9ffc1538c399 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.893449 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-8cbe4263-a5b6-4a89-8846-653e30108bcf req-071b25a3-100e-4917-a47d-9ffc1538c399 service nova] Creating event network-vif-deleted:0a0a3882-0d33-4335-8acd-cc29c3e22a89 for instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 on hv-cinder-83716 Jul 14 16:07:06.898328 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-8cbe4263-a5b6-4a89-8846-653e30108bcf req-071b25a3-100e-4917-a47d-9ffc1538c399 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029069 Jul 14 16:07:06.898933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 629/1321] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:07.046097 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:07.046710 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:07.053408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.053874 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.054630 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.055075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.118067 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.128892 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b1646e11-bcb3-4e83-9cae-4a226187471c tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1390 microversion: 2.1 time: 0.086915 Jul 14 16:07:07.131025 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 693/1322] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:07 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:08.148442 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:08.149709 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:08.157897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.164680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.164680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.164680 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.194933 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.195394 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.195850 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.objects.instance [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lazy-loading 'fault' on Instance uuid cc28cb2d-1e46-4ede-95e8-a7ed7d886159 {{(pid=129991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:07:08.264401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.264401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d7c8ebdf-f747-4610-89cb-b3dab2526659 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 200 len: 1230 microversion: 2.1 time: 0.110819 Jul 14 16:07:08.264401 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 630/1323] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:08 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:09.272904 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:09.273556 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: cc28cb2d-1e46-4ede-95e8-a7ed7d886159] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:09.281056 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.281514 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.282505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.282948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.299320 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] HTTP exception thrown: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Request method failure captured: Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 HTTP/1.1 Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D1Kpc0L6MRETEBnxP3xgG3OT1UmxtGn__iPHoweLx1L15zT71vGQxFHThoWqrRmutjS_V1BiAUwm89tECkt3sxYb7wdbA8znftBe5psCoM0lvxODAHqg86OIHbOuDaQqv6-sF3vs4wQwGLdruIpQ9YAqWHd39Vq5V6amJa_NE1RB1U Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:07:09.301146 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93233d8a364e44edad9877e1eaa82b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93233d8a364e44edad9877e1eaa82b4d"}]}] Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: ba765c1a8c6c449ca699eb7a44dde50b Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. Jul 14 16:07:09.302990 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': 'cc28cb2d-1e46-4ede-95e8-a7ed7d886159'} Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:09.304126 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. Jul 14 16:07:09.305981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:09.307755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Returning 404 to user: Instance cc28cb2d-1e46-4ede-95e8-a7ed7d886159 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:09.307755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-413e965a-acfd-46ab-a2ce-a3ff1758395e tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159" status: 404 len: 111 microversion: 2.1 time: 0.034044 Jul 14 16:07:09.307755 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 694/1324] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:09 2022] GET /compute/v2.1/servers/cc28cb2d-1e46-4ede-95e8-a7ed7d886159 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:12.682155 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:12.685679 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:12.696976 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.697458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.698475 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.699427 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.725785 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:07:12.745206 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-a5889594-808c-407e-b3bf-775a5d7f6044 req-c415a9f7-0bf2-400f-bed8-13a002ce73aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474f8df-f1f5-4398-8509-01ab192321e9", "tag": "b1731817-9056-4737-b39e-00f943116cba"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:12.753757 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a5889594-808c-407e-b3bf-775a5d7f6044 req-c415a9f7-0bf2-400f-bed8-13a002ce73aa service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.754233 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-a5889594-808c-407e-b3bf-775a5d7f6044 req-c415a9f7-0bf2-400f-bed8-13a002ce73aa service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.766708 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-a5889594-808c-407e-b3bf-775a5d7f6044 req-c415a9f7-0bf2-400f-bed8-13a002ce73aa service nova] Creating event network-changed:b1731817-9056-4737-b39e-00f943116cba for instance 8474f8df-f1f5-4398-8509-01ab192321e9 on hv-cinder-83716 Jul 14 16:07:12.775914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-a5889594-808c-407e-b3bf-775a5d7f6044 req-c415a9f7-0bf2-400f-bed8-13a002ce73aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091104 Jul 14 16:07:12.775914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 695/1325] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:13.015685 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-4f30264e-5e13-4d5e-aeea-11a1e8b95906 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 204 len: 0 microversion: 2.1 time: 0.337706 Jul 14 16:07:13.016583 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 631/1326] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:07:12 2022] DELETE /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:07:13.025482 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:13.028695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:13.033360 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.046393 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.047339 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.047980 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.194696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:13.202420 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-9e22f4b4-957f-477f-a3f0-9922be0d9886 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1577 microversion: 2.1 time: 0.181119 Jul 14 16:07:13.202961 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 696/1327] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:13 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:14.221336 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:14.222454 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:14.230213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.230213 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.230839 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.231230 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.434059 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:14.441581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-a4a727cb-e6c0-49bf-9879-909d7b67d6cc tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1577 microversion: 2.1 time: 0.224540 Jul 14 16:07:14.442189 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 632/1328] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:14 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:15.128909 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-501f548b-95d7-4916-8745-974187d4290a req-343a5919-e435-434f-a326-86dcc816e95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8474f8df-f1f5-4398-8509-01ab192321e9", "name": "network-vif-deleted", "tag": "b1731817-9056-4737-b39e-00f943116cba"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:15.138140 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-501f548b-95d7-4916-8745-974187d4290a req-343a5919-e435-434f-a326-86dcc816e95a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.142216 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-501f548b-95d7-4916-8745-974187d4290a req-343a5919-e435-434f-a326-86dcc816e95a service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.150424 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-501f548b-95d7-4916-8745-974187d4290a req-343a5919-e435-434f-a326-86dcc816e95a service nova] Creating event network-vif-deleted:b1731817-9056-4737-b39e-00f943116cba for instance 8474f8df-f1f5-4398-8509-01ab192321e9 on hv-cinder-83716 Jul 14 16:07:15.155480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-501f548b-95d7-4916-8745-974187d4290a req-343a5919-e435-434f-a326-86dcc816e95a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030281 Jul 14 16:07:15.156168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 697/1329] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:15.459541 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:15.460959 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:15.469546 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.470438 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.471498 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.472011 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.550818 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba765c1a8c6c449ca699eb7a44dde50b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93233d8a364e44edad9877e1eaa82b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.555080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-663c444c-90ac-4cee-a005-7a1e1b77da35 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 200 len: 1225 microversion: 2.1 time: 0.099386 Jul 14 16:07:15.555664 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 633/1330] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:15 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:16.572343 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:16.573038 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 8474f8df-f1f5-4398-8509-01ab192321e9] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:16.580427 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.580917 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.581695 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.582153 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.596299 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] HTTP exception thrown: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Request method failure captured: Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 HTTP/1.1 Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D1Kpc0L6MRETEBnxP3xgG3OT1UmxtGn__iPHoweLx1L15zT71vGQxFHThoWqrRmutjS_V1BiAUwm89tECkt3sxYb7wdbA8znftBe5psCoM0lvxODAHqg86OIHbOuDaQqv6-sF3vs4wQwGLdruIpQ9YAqWHd39Vq5V6amJa_NE1RB1U Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:07:16.597969 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93233d8a364e44edad9877e1eaa82b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93233d8a364e44edad9877e1eaa82b4d"}]}] Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: ba765c1a8c6c449ca699eb7a44dde50b Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. Jul 14 16:07:16.599796 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '8474f8df-f1f5-4398-8509-01ab192321e9'} Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:16.600653 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. Jul 14 16:07:16.602148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:16.603388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Returning 404 to user: Instance 8474f8df-f1f5-4398-8509-01ab192321e9 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:16.603388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-8e74017f-556a-4942-b441-c676ac636ea4 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jul 14 16:07:16.603388 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 698/1331] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:16 2022] GET /compute/v2.1/servers/8474f8df-f1f5-4398-8509-01ab192321e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:17.156443 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:17.157133 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:17.163997 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.164458 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.165234 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.168448 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.180066 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] HTTP exception thrown: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Request method failure captured: Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: DELETE /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 HTTP/1.1 Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D1Kpc0L6MRETEBnxP3xgG3OT1UmxtGn__iPHoweLx1L15zT71vGQxFHThoWqrRmutjS_V1BiAUwm89tECkt3sxYb7wdbA8znftBe5psCoM0lvxODAHqg86OIHbOuDaQqv6-sF3vs4wQwGLdruIpQ9YAqWHd39Vq5V6amJa_NE1RB1U Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:07:17.181737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93233d8a364e44edad9877e1eaa82b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93233d8a364e44edad9877e1eaa82b4d"}]}] Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: ba765c1a8c6c449ca699eb7a44dde50b Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.185141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '3f1d5480-e5d1-4ed5-ba9d-185d99c20286'} Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:17.186258 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.188564 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.191829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Returning 404 to user: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:17.191829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fdce54b5-1eba-48f7-ae4d-b0f6ff9a53a5 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 404 len: 111 microversion: 2.1 time: 0.030699 Jul 14 16:07:17.191829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 634/1332] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:07:17 2022] DELETE /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:17.194960 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:17.202819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] [instance: 3f1d5480-e5d1-4ed5-ba9d-185d99c20286] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:17.202819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.202819 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.203397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.203576 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.218664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.wsgi [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] HTTP exception thrown: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Request method failure captured: Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: request: GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 HTTP/1.1 Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept: application/json Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Accept-Encoding: identity Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Connection: close Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Length: 0 Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Content-Type: application/json Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Host: 10.222.0.47 Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Openstack-System-Scope: None Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: User-Agent: python-urllib3/1.26.9 Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Auth-Token: gAAAAABi0D1Kpc0L6MRETEBnxP3xgG3OT1UmxtGn__iPHoweLx1L15zT71vGQxFHThoWqrRmutjS_V1BiAUwm89tECkt3sxYb7wdbA8znftBe5psCoM0lvxODAHqg86OIHbOuDaQqv6-sF3vs4wQwGLdruIpQ9YAqWHd39Vq5V6amJa_NE1RB1U Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Id: None Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Domain-Name: None Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Identity-Status: Confirmed Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Is-Admin-Project: True Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Id: default Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Domain-Name: Default Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Project-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Role: reader,member Jul 14 16:07:17.220235 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Roles: reader,member Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93233d8a364e44edad9877e1eaa82b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93233d8a364e44edad9877e1eaa82b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93233d8a364e44edad9877e1eaa82b4d"}]}] Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Id: 93233d8a364e44edad9877e1eaa82b4d Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1118292031 Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Id: default Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Domain-Name: Default Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Id: ba765c1a8c6c449ca699eb7a44dde50b Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: X-User-Name: tempest-TestVolumeBootPattern-1118292031-project Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: method: > Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: exception: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.221994 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: action_args: {'id': '3f1d5480-e5d1-4ed5-ba9d-185d99c20286'} Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:07:17.225948 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. Jul 14 16:07:17.227563 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: ERROR nova.api.openstack.wsgi Jul 14 16:07:17.229471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Returning 404 to user: Instance 3f1d5480-e5d1-4ed5-ba9d-185d99c20286 could not be found. {{(pid=129992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:07:17.229471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-62c41a53-e565-4fa0-aa3b-a5b8dc02a694 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286" status: 404 len: 111 microversion: 2.1 time: 0.032459 Jul 14 16:07:17.229471 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 699/1333] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:17 2022] GET /compute/v2.1/servers/3f1d5480-e5d1-4ed5-ba9d-185d99c20286 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:18.730304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0510db92-3f95-476a-adf8-0b6a01de8aa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] Calling method '.version_select at 0x7f340411b160>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:18.954838 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0510db92-3f95-476a-adf8-0b6a01de8aa0 tempest-TestVolumeBootPattern-1118292031 tempest-TestVolumeBootPattern-1118292031-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2067800923" status: 202 len: 0 microversion: 2.1 time: 0.228427 Jul 14 16:07:18.955493 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 635/1334] 10.222.0.47 () {58 vars in 1262 bytes} [Thu Jul 14 16:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2067800923 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:14.819105 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:14.819801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:14.821764 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:14.822935 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:14.827701 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.828148 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.828903 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.829335 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.852190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lazy-loading 'flavor' on Instance uuid 835f6ce8-bec6-44fc-bc03-170b6032564e {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:08:15.305480 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ce95a0fd-9199-4eea-8c71-b92d07c3fe16 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "POST /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e/action" status: 202 len: 0 microversion: 2.1 time: 0.490184 Jul 14 16:08:15.306138 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 700/1335] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:08:14 2022] POST /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:15.316455 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:15.316455 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:15.319625 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:15.320513 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:15.325729 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.326229 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.327143 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.327584 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.489688 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.498026 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f30ee63d-e8aa-4157-927c-246804cf906f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.186867 Jul 14 16:08:15.498653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 636/1336] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:15 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:16.518279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:16.519015 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:16.526672 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.527127 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.527897 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.528338 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.665350 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.673286 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2dd8f04d-4260-4b5d-8e04-f8e05e0b0c3d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.159813 Jul 14 16:08:16.674243 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 701/1337] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:16 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:17.693022 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:17.693740 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:17.706420 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.706848 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.707648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.708096 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.903441 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.911437 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-fc7e7b5f-4342-4ab6-8e81-9298a03776aa tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.223128 Jul 14 16:08:17.912101 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 637/1338] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:17 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:18.935225 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:18.935894 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:18.942530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.942981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.943746 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.944183 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.080845 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:19.089976 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-18128c9e-9a6b-42b7-9b26-f99492239549 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.159100 Jul 14 16:08:19.090551 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 702/1339] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:18 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:20.107565 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:20.108270 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:20.114928 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.115389 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.116179 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.116618 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.251031 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:20.258811 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9958e90b-6ebd-4820-bd57-60e48eb08fcd tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.155424 Jul 14 16:08:20.259899 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 638/1340] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:20 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:21.277279 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:21.277913 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:21.284898 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.285353 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.286168 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.286611 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.419920 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:21.427616 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2fd7b864-6206-4621-926e-a0220005c26d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.154534 Jul 14 16:08:21.428187 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 703/1341] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:21 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:22.444632 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:22.445247 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:22.451990 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.452456 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.453239 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.453681 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.605167 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:22.612925 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0f3238a0-39eb-4bd3-9cd7-395abb9d432a tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.172143 Jul 14 16:08:22.613500 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 639/1342] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:22 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:23.629896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:23.630524 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:23.637999 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.638455 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.639231 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.639664 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.776877 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:23.784509 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-05effb03-dc5a-4ff7-babc-dc389d58fd33 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.158496 Jul 14 16:08:23.785081 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 704/1343] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:23 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:24.801094 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:24.801700 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:24.808350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.808806 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.809575 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.810056 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.954968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:24.963029 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-27ae4f51-1cd2-4781-b344-2d334ea75ee3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.165797 Jul 14 16:08:24.963617 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 640/1344] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:24 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:25.981738 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:25.982397 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:25.989682 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:25.990175 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:25.991281 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:25.991914 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.184557 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.193419 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3a498539-592c-44fd-ba8f-94f95893f4ea tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.216685 Jul 14 16:08:26.194066 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 705/1345] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:25 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:27.211313 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.211965 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.219581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.220030 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.220803 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.221242 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.356581 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.364138 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6bc52c5b-2510-4042-84e7-36e9d3d13dce tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.157000 Jul 14 16:08:27.364704 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 641/1346] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:27 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:28.382048 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:28.382731 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:28.392788 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.394896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.394896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.394896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.565621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.574004 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-2f15e606-3d69-469d-aa0e-8899365afced tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.196485 Jul 14 16:08:28.574981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 706/1347] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:28 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:29.592378 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:29.592995 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.600322 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.602332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.602332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.602332 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.742159 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.749845 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-c24a001e-763a-4a79-8d6e-a7d1a52bcd39 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1511 microversion: 2.1 time: 0.161399 Jul 14 16:08:29.750444 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 642/1348] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:29 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:29.769309 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:29.769985 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.777621 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.778110 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.778888 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.779328 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.138810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-7261c667-312f-46c2-897e-266474f9be69 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "POST /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e/action" status: 202 len: 0 microversion: 2.1 time: 0.372855 Jul 14 16:08:30.139416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 707/1349] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 14 16:08:29 2022] POST /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:08:30.147697 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:30.148381 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:30.156195 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.156723 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.157593 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.158131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.308574 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.317141 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-9ed1f2f6-0504-485f-9083-b8b9cbb6dd7f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1519 microversion: 2.1 time: 0.173184 Jul 14 16:08:30.318019 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 643/1350] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:30 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:30.837485 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-c8142338-b137-4e3f-ae3b-89821b645b11 req-1fd6a9f0-cacd-4194-9ace-cb183a8429ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "name": "network-vif-unplugged", "status": "completed", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:30.851893 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c8142338-b137-4e3f-ae3b-89821b645b11 req-1fd6a9f0-cacd-4194-9ace-cb183a8429ce service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.852818 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-c8142338-b137-4e3f-ae3b-89821b645b11 req-1fd6a9f0-cacd-4194-9ace-cb183a8429ce service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.866538 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.compute.server_external_events [req-c8142338-b137-4e3f-ae3b-89821b645b11 req-1fd6a9f0-cacd-4194-9ace-cb183a8429ce service nova] Unable to find a host for instance 835f6ce8-bec6-44fc-bc03-170b6032564e. Dropping event network-vif-unplugged {{(pid=129992) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 16:08:30.867059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-c8142338-b137-4e3f-ae3b-89821b645b11 req-1fd6a9f0-cacd-4194-9ace-cb183a8429ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.108173 Jul 14 16:08:30.867732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 708/1351] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 16:08:31.336280 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:31.336893 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:31.346187 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.349923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.349923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.349923 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.510227 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:31.518084 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-6452575d-8677-4833-81dc-ef52fa59459e tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1521 microversion: 2.1 time: 0.186080 Jul 14 16:08:31.521653 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 644/1352] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:31 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:32.539801 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:32.540530 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:32.548128 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.548581 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.549347 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.549787 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.684200 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.692178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-b9e346cd-5cb6-43e6-8cb3-b388e34c269b tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1521 microversion: 2.1 time: 0.156038 Jul 14 16:08:32.692454 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 709/1353] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:32 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:33.709314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.709962 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.717289 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.718080 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.718866 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.719314 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.855283 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.862810 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-0f55823b-c285-41bc-a178-7e2011dc992f tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.157465 Jul 14 16:08:33.863376 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 645/1354] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:33 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:34.880537 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.881136 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.887732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.888178 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.888931 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.889361 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.019084 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.027288 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-fe3cfab8-d742-43e3-bd64-a0d45563a4bf tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.150563 Jul 14 16:08:35.027860 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 710/1355] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:36.044829 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.045926 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.051986 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.052440 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.053208 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.053648 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.186522 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.194146 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-60128d56-2109-4cad-bd7f-8bb9b1e39df1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.153504 Jul 14 16:08:36.194721 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 646/1356] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:37.212108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:37.212698 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:37.219319 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.219777 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.220550 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.220989 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.362815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.370896 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-825d2c37-a865-4150-8279-e6075c90bfa7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.162755 Jul 14 16:08:37.371467 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 711/1357] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:37 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:38.389558 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:38.390115 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:38.396664 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.397107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.397895 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.398326 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.534218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.542158 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-5f1b293f-e260-4029-ae9c-a2ce1ecfb3a1 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.156286 Jul 14 16:08:38.542731 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 647/1358] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:38 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:38.817304 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:08:38.817584 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:08:39.558732 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:39.559408 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.565970 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.566416 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.567177 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.567607 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.703956 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.711258 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-140cc1dd-3067-4569-9873-dbad8357fc5d tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.156494 Jul 14 16:08:39.711840 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 712/1359] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:39 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:40.729218 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.729840 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.736434 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.736886 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.737667 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.738134 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.875083 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.883492 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-de102248-5c4a-48ff-8922-3a4467081de8 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.158738 Jul 14 16:08:40.884393 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 648/1360] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:41.902683 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.903251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.909847 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.910371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.911133 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.911572 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.045981 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.053770 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-0c7d8501-02e5-47fd-be87-28a4de5f9056 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.155548 Jul 14 16:08:42.054371 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 713/1361] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:42.886832 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [req-ea33207f-f2cb-4699-a902-ccec6888d079 req-c80b1f1e-7f25-41ad-9adb-0ae8f2434fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "name": "network-vif-plugged", "status": "completed", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:42.895447 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-ea33207f-f2cb-4699-a902-ccec6888d079 req-c80b1f1e-7f25-41ad-9adb-0ae8f2434fdf service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.895897 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [req-ea33207f-f2cb-4699-a902-ccec6888d079 req-c80b1f1e-7f25-41ad-9adb-0ae8f2434fdf service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.906873 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.compute.server_external_events [req-ea33207f-f2cb-4699-a902-ccec6888d079 req-c80b1f1e-7f25-41ad-9adb-0ae8f2434fdf service nova] Creating event network-vif-plugged:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:08:42.914301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [req-ea33207f-f2cb-4699-a902-ccec6888d079 req-c80b1f1e-7f25-41ad-9adb-0ae8f2434fdf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029026 Jul 14 16:08:42.914301 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 649/1362] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:43.070861 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:43.073299 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:43.078049 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.078505 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.079270 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.079708 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.083815 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:43.223100 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.231837 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-3f9eabb8-3eb4-4787-85a0-21f5b5e7fd73 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.164839 Jul 14 16:08:43.238592 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 714/1363] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:43 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:44.250037 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.250736 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.256916 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.257363 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.258323 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.258762 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.393382 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:44.401538 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-d88c7e8a-ae64-4b6d-8232-7eedf35e5061 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1577 microversion: 2.1 time: 0.156249 Jul 14 16:08:44.402153 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 650/1364] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:45.419174 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.419786 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:45.422042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=33 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:45.427059 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.427512 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.428276 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.428718 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.560560 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.568099 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-76d7541b-ae77-4d25-b9d9-e2384cc91775 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1564 microversion: 2.1 time: 0.153426 Jul 14 16:08:45.568662 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 715/1365] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:45 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:05.019107 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0aaf8f85-ca37-4011-8d02-8f29cd4b1379] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:10:05.019849 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_api:SELECT=30 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.023665 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_api:SELECT=1 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.024574 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG dbcounter [-] [129992] Writing DB stats nova_cell1:SELECT=10 {{(pid=129992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.028522 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-e7b90f6c-99e1-4a29-91ea-d788b3112e80 req-b0335683-1a1c-49e7-a354-bc0849634d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:05.031865 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG dbcounter [-] [129991] Writing DB stats nova_cell1:SELECT=86 {{(pid=129991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.036485 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.037241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.048696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-e7b90f6c-99e1-4a29-91ea-d788b3112e80 req-b0335683-1a1c-49e7-a354-bc0849634d9b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.049157 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-e7b90f6c-99e1-4a29-91ea-d788b3112e80 req-b0335683-1a1c-49e7-a354-bc0849634d9b service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.054344 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.054835 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.055784 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.056241 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.065450 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-e7b90f6c-99e1-4a29-91ea-d788b3112e80 req-b0335683-1a1c-49e7-a354-bc0849634d9b service nova] Creating event network-changed:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:10:05.072982 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-e7b90f6c-99e1-4a29-91ea-d788b3112e80 req-b0335683-1a1c-49e7-a354-bc0849634d9b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051183 Jul 14 16:10:05.073868 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 716/1366] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:05.095635 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Going to try to terminate instance {{(pid=129991) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:10:05.469737 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-df47a0c3-46b0-4aa3-a830-f83120d0dba3 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "DELETE /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 204 len: 0 microversion: 2.1 time: 0.452530 Jul 14 16:10:05.474671 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 651/1367] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 14 16:10:05 2022] DELETE /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:10:05.481315 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.482070 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.488898 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.489358 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.490170 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.491303 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.649390 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.657192 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-cebf1fdc-45ea-49f1-9bb1-23b25d85bfca tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.181349 Jul 14 16:10:05.657774 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 717/1368] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:05 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:06.114621 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:06.115231 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:06.675781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:06.676501 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:06.691227 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] [0aaf8f85-ca37-4011-8d02-8f29cd4b1379] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 55868. Jul 14 16:10:06.693152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.694217 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.694906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.695415 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.837778 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:06.845573 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-ed3cdf44-dc28-493c-8bd9-a1a1d1cfd4b9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1570 microversion: 2.1 time: 0.174243 Jul 14 16:10:06.846172 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 652/1369] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:06 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:07.675156 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [req-4a5142bc-567d-4c57-b684-820e86446c8b req-56f5103f-d32c-4f28-8b25-7a499beabdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835f6ce8-bec6-44fc-bc03-170b6032564e", "name": "network-vif-deleted", "tag": "8567babb-8e44-4a50-bb2c-359e53b088b2"}]} {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:07.683143 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-4a5142bc-567d-4c57-b684-820e86446c8b req-56f5103f-d32c-4f28-8b25-7a499beabdf6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.683747 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [req-4a5142bc-567d-4c57-b684-820e86446c8b req-56f5103f-d32c-4f28-8b25-7a499beabdf6 service nova] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.699964 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.compute.server_external_events [req-4a5142bc-567d-4c57-b684-820e86446c8b req-56f5103f-d32c-4f28-8b25-7a499beabdf6 service nova] Creating event network-vif-deleted:8567babb-8e44-4a50-bb2c-359e53b088b2 for instance 835f6ce8-bec6-44fc-bc03-170b6032564e on hv-cinder-83716 Jul 14 16:10:07.705381 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [req-4a5142bc-567d-4c57-b684-820e86446c8b req-56f5103f-d32c-4f28-8b25-7a499beabdf6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Jul 14 16:10:07.706108 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 718/1370] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:07.862551 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:07.863131 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:07.870781 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.871154 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.871968 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.872405 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.942496 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.policy [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129991) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.951613 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-f391a579-4dec-41fc-b57c-4421482b5c60 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1219 microversion: 2.1 time: 0.092946 Jul 14 16:10:07.952238 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 653/1371] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:07 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:08.971022 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.971730 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.compute.api [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129992) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.978032 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.978488 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.979251 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.979696 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.012506 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.012952 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG oslo_concurrency.lockutils [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.013434 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.objects.instance [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lazy-loading 'fault' on Instance uuid 835f6ce8-bec6-44fc-bc03-170b6032564e {{(pid=129992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:10:09.109042 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.policy [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d16fe0fde164dd8b0652168fc438263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955b9d20401546f9a3f8477a9e67fc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129992) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:09.117014 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-f9e2a148-2483-4b74-98be-787aa4619ee7 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 200 len: 1224 microversion: 2.1 time: 0.150885 Jul 14 16:10:09.117689 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 719/1372] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:08 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 1224 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:10.134725 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '>' {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:10.135343 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.compute.api [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] [instance: 835f6ce8-bec6-44fc-bc03-170b6032564e] Fetching instance by UUID {{(pid=129991) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:10.142012 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:10.142467 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:10.143286 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:10.143754 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG oslo_concurrency.lockutils [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Lock "c2ee7a97-dc57-4e4f-9b70-59117f70fb54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:10.159708 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.wsgi [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] HTTP exception thrown: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Request method failure captured: Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: request: GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e HTTP/1.1 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept: application/json Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Accept-Encoding: identity Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Connection: close Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Length: 0 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Content-Type: application/json Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Host: 10.222.0.47 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Openstack-System-Scope: None Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: User-Agent: python-urllib3/1.26.9 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Auth-Token: gAAAAABi0D7HC_Ixn8ruBJ42fxS_Ik0IJex-WFbcmgIkkgx9HVUqX9G218yQwb-3p69gAeVAnOZHqqD7mrM-rpgOSgAeQfrWCB1UaCmpaclQVbLby7Np99KwxeRQiguOexjE_2Fyapi7P2Fh60DWCeTHk0JYGBKyl-4MmR40WrPGZ5y7dhBDjHo Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Id: None Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Domain-Name: None Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Identity-Status: Confirmed Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Is-Admin-Project: True Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Id: default Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Domain-Name: Default Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Id: 955b9d20401546f9a3f8477a9e67fc24 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Project-Name: tempest-TestShelveInstance-996609409 Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Role: reader,member Jul 14 16:10:10.161352 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Roles: reader,member Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/955b9d20401546f9a3f8477a9e67fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_955b9d20401546f9a3f8477a9e67fc24", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/955b9d20401546f9a3f8477a9e67fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/955b9d20401546f9a3f8477a9e67fc24"}]}] Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant: tempest-TestShelveInstance-996609409 Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Id: 955b9d20401546f9a3f8477a9e67fc24 Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-Tenant-Name: tempest-TestShelveInstance-996609409 Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User: tempest-TestShelveInstance-996609409-project Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Id: default Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Domain-Name: Default Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Id: 0d16fe0fde164dd8b0652168fc438263 Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: X-User-Name: tempest-TestShelveInstance-996609409-project Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: method: > Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: exception: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. Jul 14 16:10:10.163201 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: action_args: {'id': '835f6ce8-bec6-44fc-bc03-170b6032564e'} Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: {{(pid=129991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:10:10.164284 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. Jul 14 16:10:10.166350 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: ERROR nova.api.openstack.wsgi Jul 14 16:10:10.167906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: DEBUG nova.api.openstack.wsgi [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Returning 404 to user: Instance 835f6ce8-bec6-44fc-bc03-170b6032564e could not be found. {{(pid=129991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:10:10.167906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO nova.api.openstack.requestlog [None req-27833d9b-e2cc-486e-8ed3-d2c760046050 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e" status: 404 len: 111 microversion: 2.1 time: 0.032706 Jul 14 16:10:10.167906 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: [pid: 129991|app: 0|req: 654/1373] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:10 2022] GET /compute/v2.1/servers/835f6ce8-bec6-44fc-bc03-170b6032564e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:10:10.394075 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: DEBUG nova.api.openstack.wsgi [None req-ddaa2a52-8402-4377-bb32-bf035a7094a9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] Calling method '.version_select at 0x7f3407e1bdc0>' {{(pid=129992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:10.464575 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO nova.api.openstack.requestlog [None req-ddaa2a52-8402-4377-bb32-bf035a7094a9 tempest-TestShelveInstance-996609409 tempest-TestShelveInstance-996609409-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1368178498" status: 202 len: 0 microversion: 2.1 time: 0.074383 Jul 14 16:10:10.465173 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: [pid: 129992|app: 0|req: 720/1374] 10.222.0.47 () {58 vars in 1253 bytes} [Thu Jul 14 16:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1368178498 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:11:58.827105 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:11:58.827758 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:11:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:12:43.457703 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:12:43.458190 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Thu Jul 14 16:12:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:13:26.123798 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:13:26.124361 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:13:36.060562 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:13:36.061028 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Thu Jul 14 16:13:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:15:18.835152 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:18.835861 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:15:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:15:32.757214 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:32.757810 dv-cinder-837164-3-iscsi devstack@n-api.service[129992]: Thu Jul 14 16:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:15:33.307125 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:33.307627 dv-cinder-837164-3-iscsi devstack@n-api.service[129991]: Thu Jul 14 16:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!